00010000:00010000:2.0F:1789048808.029716:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1789048808.413592:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111492224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048808.413696:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1789048808.413859:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492224 00000100:00100000:3.0:1789048808.413877:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492224 00000100:00100000:3.0:1789048808.413960:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048808.413972:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111492224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048808.414011:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0F:1789048808.418040:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048808.420440:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111492224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6454us (6727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048808.420460:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789048808.420845:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111492224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048808.541000:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048808.541059:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048808.541091:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784832 00000100:00100000:3.0:1789048808.541105:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784832 00000100:00100000:0.0:1789048808.541155:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048808.541229:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:0.0:1789048808.541234:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048808.541245:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2394:x1875953097784832:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048808.541255:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048808.541273:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785088 00000100:00100000:1.0:1789048808.541278:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785088 00000100:00080000:3.0:1789048808.541314:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048808.541327:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097784960 00000100:00100000:1.0:1789048808.541358:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097784960 00000100:00100000:1.0:1789048808.541395:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:1.0:1789048808.541403:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097785088:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048808.541629:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097785088:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 225us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048808.541639:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:1.0:1789048808.541662:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:1.0:1789048808.541669:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+26:2394:x1875953097784960:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048808.543473:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2394:x1875953097784832:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 2216us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048808.543490:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:1.0:1789048808.543550:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+26:2394:x1875953097784960:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1789us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048808.543562:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:1.0:1789048808.543590:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785472 00000100:00100000:1.0:1789048808.543598:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785472 00000100:00100000:1.0:1789048808.543638:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00100000:1.0:1789048808.543647:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2393:x1875953097785472:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048808.543697:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2393:x1875953097785472:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 51us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048808.543703:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 80 00000100:00080000:1.0:1789048808.543728:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048808.543838:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048808.543960:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048808.543991:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048808.544024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048808.544483:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785344 00000100:00100000:2.0:1789048808.544490:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785344 00000100:00100000:2.0:1789048808.544523:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785216 00000100:00100000:2.0:1789048808.544526:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785216 00000100:00100000:2.0:1789048808.544559:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785728 00000100:00100000:2.0:1789048808.544562:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785728 00000100:00100000:2.0:1789048808.544574:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785856 00000100:00100000:2.0:1789048808.544576:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785856 00000100:00100000:2.0:1789048808.544714:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789048808.544723:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+10:2393:x1875953097785344:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048808.544768:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+10:2393:x1875953097785344:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (3533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048808.544775:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789048808.544791:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789048808.544797:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2390:x1875953097785216:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:2.0:1789048808.544832:0:18630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777427 00000100:00080000:2.0:1789048808.544850:0:18630:0:(import.c:65:import_set_state_nolock()) ffff959c322c1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048808.544903:0:18630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789048808.545052:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+2:2390:x1875953097785216:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 254us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048808.545059:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:2.0:1789048808.545071:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:2.0:1789048808.545096:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2390:x1875953097785728:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:2.0:1789048808.545108:0:18630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777466 00000100:00080000:2.0:1789048808.545113:0:18630:0:(import.c:65:import_set_state_nolock()) ffff959b08c26000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048808.545148:0:18630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789048808.545198:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+2:2390:x1875953097785728:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 103us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048808.545204:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:2.0:1789048808.545217:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789048808.545223:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2390:x1875953097785856:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:2.0:1789048808.545234:0:18630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877746d 00000100:00080000:2.0:1789048808.545243:0:18630:0:(import.c:65:import_set_state_nolock()) ffff959b08c22000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048808.545260:0:18630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1789048808.545627:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785600 00000100:00100000:1.0:1789048808.545633:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785600 00000100:00100000:1.0:1789048808.545681:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00100000:1.0:1789048808.545689:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2393:x1875953097785600:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048808.545736:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2393:x1875953097785600:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048808.545742:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 81 00000100:00080000:1.0:1789048808.545771:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048808.545776:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048808.545779:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048808.547053:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0810a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e75ca1a9-3972-4d73-931e-9ff32f454dcc+2:2390:x1875953097785856:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 1822us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048808.547067:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00010000:00010000:2.0:1789048808.547114:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048808.547123:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789048808.547972:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000020:00000080:1.0:1789048808.547980:0:19445:0:(genops.c:885:class_export_put()) final put ffff959b08c20000/e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00080000:1.0:1789048808.548028:0:19445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1789048808.548038:0:19445:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000020:00000080:0.0:1789048808.548098:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08c20000/e75ca1a9-3972-4d73-931e-9ff32f454dcc for lustre-OST0001 00000020:00000080:0.0:1789048808.548167:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08c22000 for lustre-OST0001 00010000:00010000:2.0:1789048809.053662:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048809.444520:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111492352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048809.444659:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048809.444786:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492352 00000100:00100000:1.0:1789048809.444795:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492352 00000100:00100000:1.0:1789048809.444864:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789048809.444875:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111492352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048809.444906:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048809.444958:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111492352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048809.444966:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789048809.444993:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048809.445067:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08885f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111492352:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1789048809.454471:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00080000:2.0:1789048809.454504:0:17102:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff959c07a21d80 refcount 2 committed 0 result 0 batchid 4294967537 00000020:00080000:2.0:1789048809.454512:0:17102:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959b06aae100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff959c07a21000 00000020:00080000:2.0:1789048809.454515:0:17102:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff959b06aae200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff959c323a1200 00000020:00080000:2.0:1789048809.454548:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967537 committed batchid 8 00000020:00080000:2.0:1789048809.454645:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789048809.454918:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048809.454932:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048809.454953:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048809.454975:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3da00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048809.454981:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048809.454992:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048809.455139:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:1.0:1789048809.455143:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789048809.455150:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048809.455159:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3da00/0x133f221c0877776f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048810.087506:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048810.462919:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048810.462954:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111492480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048810.463026:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048810.463093:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492480 00000100:00100000:2.0:1789048810.463101:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492480 00000100:00100000:2.0:1789048810.463156:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789048810.463164:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111492480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048810.463198:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789048810.463252:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111492480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048810.463258:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789048810.463303:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111492480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048810.907191:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048810.907303:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097785984 00000100:00100000:1.0:1789048810.907313:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097785984 00000100:00100000:1.0:1789048810.907425:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00100000:1.0:1789048810.907436:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:15573:x1875953097785984:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789048810.907541:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:15573:x1875953097785984:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 107us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048810.907549:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 74 00000100:00080000:2.0:1789048810.907803:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789048810.914609:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048810.914733:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097786112 00000100:00100000:1.0:1789048810.914743:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097786112 00000100:00100000:1.0:1789048810.914908:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00100000:1.0:1789048810.914921:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:15573:x1875953097786112:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789048810.915063:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:15573:x1875953097786112:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 145us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048810.915071:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 75 00000100:00080000:2.0:1789048810.915103:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048810.927017:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048810.927376:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097786368 00000100:00100000:1.0:1789048810.927387:0:17125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097786368 00000100:00100000:1.0:1789048810.927449:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048810.927460:0:17125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c41506c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:15573:x1875953097786368:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789048810.927700:0:17125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c41506c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+13:15573:x1875953097786368:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 241us (692us total) trans 8589934638 rc 0/0 00000100:00100000:1.0:1789048810.927707:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789048810.973613:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111492608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048810.973690:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048810.973816:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492608 00000100:00100000:2.0:1789048810.973826:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492608 00000100:00100000:2.0:1789048810.973882:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789048810.973892:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111492608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048810.973927:0:17127:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048810.973975:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111492608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048810.973982:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789048810.974084:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111492608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048810.974568:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111492736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048810.974605:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048810.974643:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492736 00000100:00100000:1.0:1789048810.974648:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492736 00000100:00100000:1.0:1789048810.974683:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048810.974690:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111492736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048810.974711:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048810.974746:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111492736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048810.974752:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048810.974782:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789048810.974788:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff959b08887b80, transno 8589934596 00000004:00080000:1.0:1789048810.974798:0:3620:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789048810.974818:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111492736:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789048810.974990:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048810.975432:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048810.975442:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c323e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111492864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048810.975477:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048810.975507:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492864 00000100:00100000:3.0:1789048810.975512:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492864 00000100:00100000:3.0:1789048810.975549:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048810.975556:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111492864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048810.975569:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789048810.975601:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111492864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048810.975607:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789048810.975624:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048810.975661:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c323e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111492864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048810.978032:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111492992:0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.978038:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111493376:0@lo:400:kworker.0 00000100:00100000:1.0:1789048810.978522:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111493120:0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.978606:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048810.978647:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111493504:0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.978684:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048810.978713:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111494016:0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.978735:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048810.978768:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111492992 00000100:00100000:2.0:1789048810.978775:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111492992 00000100:00100000:2.0:1789048810.978822:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789048810.978830:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111492992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.978882:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111492992:12345-0@lo:400:kworker.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048810.978889:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789048810.978926:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493504 00000100:00100000:2.0:1789048810.978930:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493504 00000100:00100000:2.0:1789048810.978954:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494016 00000100:00100000:2.0:1789048810.978957:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494016 00000100:00100000:2.0:1789048810.978985:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789048810.978990:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111493504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.979019:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111493504:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048810.979024:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789048810.979691:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789048810.979704:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111494016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048810.979749:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111494016:12345-0@lo:400:kworker.0 Request processed in 49us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048810.979755:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1789048810.979893:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b083b2d80 x1875953111494016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048810.979908:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111494016:0@lo:400:kworker.0 00000100:00100000:3.0:1789048810.979917:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111492992:0@lo:400:kworker.0 00000100:00100000:3.0:1789048810.979928:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111493504:0@lo:400:kworker.0 00000100:00080000:3.0:1789048810.979966:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048810.984372:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048810.984416:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111493632:0@lo:400:kworker.0 00000100:00100000:1.0:1789048810.984456:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048810.984599:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493120 00000100:00100000:2.0:1789048810.984608:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493120 00000100:00100000:2.0:1789048810.984678:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048810.984688:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111493120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.984743:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111493120:12345-0@lo:400:kworker.0 Request processed in 57us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048810.984751:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789048810.984886:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048810.984920:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111493120:0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.984986:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048810.985020:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111493888:0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985059:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048810.985089:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048810.985097:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111493248:0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985131:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048810.985152:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111493760:0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985174:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048810.985203:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493632 00000100:00100000:0.0:1789048810.985207:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493632 00000100:00100000:0.0:1789048810.985244:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493888 00000100:00100000:0.0:1789048810.985247:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493888 00000100:00100000:0.0:1789048810.985275:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493248 00000100:00100000:0.0:1789048810.985278:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493248 00000100:00100000:0.0:1789048810.985290:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493760 00000100:00100000:0.0:1789048810.985293:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493760 00000100:00100000:0.0:1789048810.985306:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789048810.985312:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111493632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985373:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111493632:12345-0@lo:400:kworker.0 Request processed in 60us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048810.985378:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789048810.985393:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789048810.985399:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985431:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3621:x1875953111493888:12345-0@lo:400:kworker.0 Request processed in 33us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048810.985437:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789048810.985447:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789048810.985452:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985476:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111493248:12345-0@lo:400:kworker.0 Request processed in 24us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048810.985481:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789048810.985491:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789048810.985497:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111493760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985523:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111493760:12345-0@lo:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048810.985528:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789048810.985540:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048810.985542:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048810.985558:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111493248:0@lo:400:kworker.0 00010000:00080000:0.0:1789048810.985579:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b083b1500 x1875953111493760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048810.985589:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111493760:0@lo:400:kworker.0 00000100:00100000:0.0:1789048810.985597:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111493888:0@lo:400:kworker.0 00000100:00100000:1.0:1789048810.985706:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111493632:0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.985835:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111493376 00000100:00100000:2.0:1789048810.985954:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111493376 00000100:00100000:2.0:1789048810.985991:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048810.985999:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111493376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048810.986176:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111493376:12345-0@lo:400:kworker.0 Request processed in 178us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048810.986183:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789048810.986651:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b083b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111493376:0@lo:400:kworker.0 00010000:00010000:2.0:1789048811.101611:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048811.678011:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048812.125841:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048813.152841:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789048813.466021:0:20498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:00:12 (1789048812) 00000100:00100000:0.0:1789048813.533901:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048813.533926:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111494144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048813.533997:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048813.534107:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494144 00000100:00100000:1.0:1789048813.534115:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494144 00000100:00100000:1.0:1789048813.534189:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789048813.534198:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111494144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048813.534227:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048813.534279:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111494144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048813.534286:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789048813.534358:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111494144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789048813.534546:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048813.632886:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048813.632925:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048813.632943:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048813.632958:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048813.632973:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048813.632992:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048813.633162:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097786496 00000100:00100000:3.0:1789048813.633171:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097786496 00000100:00100000:3.0:1789048813.633218:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:3.0:1789048813.633227:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2391:x1875953097786496:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048813.633289:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5d991937-03b3-45a3-961b-b41aa0369386+13:2391:x1875953097786496:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 63us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048813.633296:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:3.0:1789048813.633325:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097786752 00000100:00100000:3.0:1789048813.633328:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097786752 00000100:00100000:3.0:1789048813.633375:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787008 00000100:00100000:3.0:1789048813.633378:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787008 00000100:00100000:3.0:1789048813.633389:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097786624 00000100:00100000:3.0:1789048813.633391:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097786624 00000100:00100000:3.0:1789048813.633414:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787136 00000100:00100000:3.0:1789048813.633417:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787136 00000100:00100000:3.0:1789048813.633429:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:3.0:1789048813.633434:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097786752:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048813.633461:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2391:x1875953097786752:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048813.633467:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 88 00000100:00100000:3.0:1789048813.633477:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:3.0:1789048813.633482:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2391:x1875953097787008:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048813.633500:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2391:x1875953097787008:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048813.633506:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 89 00000100:00100000:3.0:1789048813.633514:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:3.0:1789048813.633519:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+13:2391:x1875953097786624:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048813.633538:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+13:2391:x1875953097786624:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 19us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048813.633543:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 90 00000100:00100000:3.0:1789048813.633553:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00100000:3.0:1789048813.633558:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097787136:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048813.633579:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2391:x1875953097787136:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048813.633585:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 91 00000100:00080000:3.0:1789048813.633718:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048813.633723:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048813.634618:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097786880 00000100:00100000:0.0:1789048813.634628:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097786880 00000100:00100000:0.0:1789048813.634683:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789048813.634691:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097786880:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048813.634739:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b083b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2391:x1875953097786880:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 48us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048813.634746:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00080000:3.0:1789048813.634883:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789048814.063384:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000020:00000080:1.0:1789048814.063393:0:18626:0:(genops.c:885:class_export_put()) final put ffff959b08c23800/e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00100000:1.0:1789048814.063434:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000020:00000080:1.0:1789048814.063437:0:18626:0:(genops.c:885:class_export_put()) final put ffff959c322c4000/a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000020:00000080:2.0:1789048814.064115:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08c23800/e75ca1a9-3972-4d73-931e-9ff32f454dcc for lustre-OST0000 00000020:00000080:2.0:1789048814.064190:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c322c4000/a39ccd94-ab5b-4707-8ce7-49dceae587e6 for lustre-OST0000 00000020:00000080:2.0:1789048814.064209:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08c26000 for lustre-OST0000 00000020:00000080:2.0:1789048814.064214:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c322c1000 for lustre-OST0000 00010000:00010000:2.0:1789048814.178224:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048814.569044:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111494272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048814.569140:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048814.569426:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494272 00000100:00100000:2.0:1789048814.569435:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494272 00000100:00100000:2.0:1789048814.569502:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789048814.569512:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111494272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048814.569534:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048814.569582:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111494272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048814.569590:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789048814.569655:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111494272:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789048814.570151:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789048814.880177:0:17157:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789048814.880186:0:17157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048814.880208:0:17157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789048814.880217:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:2.0:1789048815.077867:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00080000:2.0:1789048815.077895:0:17102:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967537 batchid updated 00000020:00080000:0.0:1789048815.077990:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967537 00000020:00080000:0.0:1789048815.078009:0:17162:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967537 00010000:00010000:0.0:1789048815.207578:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048815.584155:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048815.584177:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111494400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048815.584250:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048815.585914:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494400 00000100:00100000:2.0:1789048815.585927:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494400 00000100:00100000:2.0:1789048815.585995:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789048815.586006:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111494400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048815.586057:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789048815.586524:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111494400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 518us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048815.586533:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789048815.586635:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111494400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048816.093976:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c323e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111494528:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094048:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.094114:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111495040:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094142:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.094162:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111495552:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094182:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.094204:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789048816.094210:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111494656:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094234:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.094251:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111495168:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094273:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.094290:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111495680:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094309:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.094354:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111494784:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.094376:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048816.095365:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111494912:0@lo:400:kworker.0 00000100:00100000:2.0:1789048816.099229:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111496192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048816.099295:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048816.099353:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048816.099361:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111496064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048816.099385:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048816.099429:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495168 00000100:00100000:2.0:1789048816.099436:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495168 00000100:00100000:2.0:1789048816.099832:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494784 00000100:00100000:2.0:1789048816.099838:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494784 00000100:00100000:2.0:1789048816.099862:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789048816.099871:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111495168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048816.099920:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111495168:12345-0@lo:400:kworker.0 Request processed in 50us (5645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048816.099926:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789048816.099946:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789048816.099953:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111494784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048816.099981:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111494784:12345-0@lo:400:kworker.0 Request processed in 29us (5603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048816.099999:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789048816.100018:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496192 00000100:00100000:2.0:1789048816.100022:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496192 00000100:00100000:2.0:1789048816.100064:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496064 00000100:00100000:2.0:1789048816.100068:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496064 00000100:00100000:2.0:1789048816.100084:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048816.100090:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111496192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048816.100536:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789048816.100582:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111496192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 491us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048816.100588:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048816.100602:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048816.100609:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111496064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048816.100619:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789048816.100641:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111496064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048816.100646:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789048816.100666:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048816.100670:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048816.100711:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111496064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048816.100723:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0820d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111496192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048816.102468:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111494784:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.102481:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111495296:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.102525:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.102562:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111495808:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.102588:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.102624:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111496320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048816.102649:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048816.102696:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494528 00000100:00100000:3.0:1789048816.102703:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494528 00000100:00100000:3.0:1789048816.102742:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789048816.102751:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111494528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.102794:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3622:x1875953111494528:12345-0@lo:400:kworker.0 Request processed in 45us (8746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.102801:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789048816.102832:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495040 00000100:00100000:3.0:1789048816.102836:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495040 00000100:00100000:3.0:1789048816.102854:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495552 00000100:00100000:3.0:1789048816.102857:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495552 00000100:00100000:3.0:1789048816.102877:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495680 00000100:00100000:3.0:1789048816.102879:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495680 00000100:00100000:3.0:1789048816.102890:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495808 00000100:00100000:3.0:1789048816.102892:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495808 00000100:00100000:3.0:1789048816.102907:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789048816.102913:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111495040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.102946:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111495040:12345-0@lo:400:kworker.0 Request processed in 33us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.102952:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789048816.102964:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048816.102970:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111495552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.102997:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111495552:12345-0@lo:400:kworker.0 Request processed in 28us (8813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.103010:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789048816.103023:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048816.103029:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111495680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.103087:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111495680:12345-0@lo:400:kworker.0 Request processed in 59us (8777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.103093:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048816.103116:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048816.103124:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111495808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.103158:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875953111495808:12345-0@lo:400:kworker.0 Request processed in 36us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.103164:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048816.103183:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494656 00000100:00100000:3.0:1789048816.103187:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494656 00000100:00100000:3.0:1789048816.103207:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496320 00000100:00100000:3.0:1789048816.103209:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496320 00000100:00100000:3.0:1789048816.103220:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789048816.103226:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111494656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.103259:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875953111494656:12345-0@lo:400:kworker.0 Request processed in 33us (9024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.103265:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789048816.103277:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048816.103282:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111496320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789048816.103306:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789048816.103359:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111496320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.103375:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048816.103395:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495296 00000100:00100000:3.0:1789048816.103398:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495296 00000100:00100000:3.0:1789048816.103421:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048816.103428:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111495296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.103460:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111495296:12345-0@lo:400:kworker.0 Request processed in 33us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048816.103465:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048816.103518:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111496320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048816.103530:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111495296:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.103540:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3620:1875953111495808:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.109644:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111494656:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.109664:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111495168:0@lo:400:kworker.0 00010000:00080000:3.0:1789048816.109679:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3958ce00 x1875953111495680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048816.109690:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111495680:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.109702:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c323e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111494528:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.109714:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111495040:0@lo:400:kworker.0 00000100:00100000:3.0:1789048816.109725:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111495552:0@lo:400:kworker.0 00000100:00080000:2.0:1789048816.109889:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789048816.109896:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048816.114422:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048816.114688:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111495424:0@lo:400:kworker.0 00000100:00100000:0.0:1789048816.114727:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048816.114753:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111495936:0@lo:400:kworker.0 00000100:00100000:0.0:1789048816.114773:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048816.114809:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495424 00000100:00100000:0.0:1789048816.114817:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495424 00000100:00100000:0.0:1789048816.114866:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111495936 00000100:00100000:0.0:1789048816.114869:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111495936 00000100:00100000:0.0:1789048816.114898:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789048816.114906:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111495424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048816.114955:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111495424:12345-0@lo:400:kworker.0 Request processed in 49us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048816.114963:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789048816.114979:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789048816.114985:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111495936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048816.115010:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111495936:12345-0@lo:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048816.115014:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789048816.115050:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3958dc00 x1875953111495936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048816.115074:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111495936:0@lo:400:kworker.0 00000100:00100000:0.0:1789048816.115100:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111495424:0@lo:400:kworker.0 00000100:00080000:2.0:1789048816.115202:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048816.115304:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111494912 00000100:00100000:1.0:1789048816.115309:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111494912 00000100:00100000:1.0:1789048816.115358:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789048816.115366:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111494912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048816.115421:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111494912:12345-0@lo:400:kworker.0 Request processed in 56us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048816.115428:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048816.120664:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111494912:0@lo:400:kworker.0 00010000:00010000:2.0:1789048816.223548:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048817.245671:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048818.270944:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048818.654485:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048818.654513:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111496448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048818.654597:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048818.654726:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496448 00000100:00100000:2.0:1789048818.654734:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496448 00000100:00100000:2.0:1789048818.654815:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789048818.654826:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111496448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048818.654867:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048818.654933:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111496448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048818.654941:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789048818.655066:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048818.655103:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111496448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048818.749891:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048818.749944:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048818.749982:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048818.750015:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048818.750026:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787520 00000100:00100000:1.0:1789048818.750047:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787520 00000100:00100000:0.0:1789048818.750070:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048818.750106:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787776 00000100:00100000:0.0:1789048818.750106:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048818.750109:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787776 00000100:00100000:1.0:1789048818.750122:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787904 00000100:00100000:0.0:1789048818.750122:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787392 00000100:00100000:1.0:1789048818.750124:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787904 00000100:00100000:0.0:1789048818.750125:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787392 00000100:00100000:1.0:1789048818.750141:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:1.0:1789048818.750162:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097787520:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048818.750181:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787264 00000100:00100000:3.0:1789048818.750186:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787264 00000100:00100000:3.0:1789048818.750213:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:3.0:1789048818.750219:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:2394:x1875953097787264:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048818.750235:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2394:x1875953097787520:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048818.750243:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5d991937-03b3-45a3-961b-b41aa0369386+13:2394:x1875953097787264:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048818.750320:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:3.0:1789048818.750415:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097787648 00000100:00100000:3.0:1789048818.750419:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097787648 00000100:00100000:3.0:1789048818.750451:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789048818.750458:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2394:x1875953097787648:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048818.750486:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2394:x1875953097787648:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048818.750493:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:0.0:1789048818.752829:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:0.0:1789048818.752858:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2394:x1875953097787776:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048818.753676:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2394:x1875953097787776:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 826us (3687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048818.753689:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 99 00000100:00100000:0.0:1789048818.753730:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:0.0:1789048818.753742:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097787904:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048818.753783:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2394:x1875953097787904:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (3677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048818.753789:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 100 00000100:00100000:0.0:1789048818.753803:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00100000:0.0:1789048818.753811:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:2394:x1875953097787392:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048818.754935:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:2394:x1875953097787392:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1108us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048818.754962:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 101 00000100:00080000:0.0:1789048818.755189:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048818.755194:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048818.755197:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048818.759505:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 98 00000100:00100000:3.0:1789048818.908769:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048818.908811:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048818.908845:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048818.908944:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097788032 00000100:00100000:1.0:1789048818.908954:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097788032 00000100:00100000:1.0:1789048818.909003:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097788288 00000100:00100000:1.0:1789048818.909007:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097788288 00000100:00100000:1.0:1789048818.909020:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097788160 00000100:00100000:1.0:1789048818.909023:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097788160 00000100:00100000:1.0:1789048818.909070:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789048818.909090:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+15:2391:x1875953097788032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048818.909108:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048818.909131:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1400/0x133f221c08777404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ac8 expref: 15 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048818.909150:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048818.909240:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+14:2391:x1875953097788032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 160us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048818.909248:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789048818.909265:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789048818.909271:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+13:2391:x1875953097788288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048818.909279:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048818.909288:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061800/0x133f221c087774c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29baf expref: 13 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048818.909296:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048818.909313:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+12:2391:x1875953097788288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 43us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048818.909319:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789048818.909390:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1789048818.909398:0:17107:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+11:2391:x1875953097788160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048818.909406:0:17107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048818.909414:0:17107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1600/0x133f221c0877740b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29af9 expref: 11 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048818.909422:0:17107:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048818.909438:0:17107:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d991937-03b3-45a3-961b-b41aa0369386+10:2391:x1875953097788160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 42us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048818.909443:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789048818.916822:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048818.916924:0:18632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097788544 00000100:00100000:2.0:1789048818.916935:0:18632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097788544 00000100:00100000:2.0:1789048818.916996:0:18632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1789048818.917006:0:18632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+6:2390:x1875953097788544:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:2.0:1789048818.917055:0:18632:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877742e 00000020:00010000:2.0:1789048818.917065:0:18632:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959b08c24800: total 0 00000100:00080000:2.0:1789048818.917069:0:18632:0:(import.c:65:import_set_state_nolock()) ffff959b06939000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048818.917123:0:18632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000020:00010000:0.0:1789048818.917357:0:17110:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959b08c24800: total 0 00010000:00010000:0.0:1789048818.917360:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048818.917409:0:17110:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959b08c24800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1789048818.917442:0:17110:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789048818.917446:0:17110:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789048803835000000 -> 1789048804218090370 00002000:00010000:0.0:1789048818.917448:0:17110:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789048803835000000 -> 1789048804218090370 00002000:00010000:0.0:1789048818.917451:0:17110:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789048818.917475:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098681c2/0x133f221c08777799 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c8f expref: 5 pid: 18631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048818.917500:0:17110:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959b08c24800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789048818.917511:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048818.917513:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048818.917514:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048818.917821:0:18632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a39ccd94-ab5b-4707-8ce7-49dceae587e6+2:2390:x1875953097788544:12345-192.168.202.16@tcp:9:umount.0 Request processed in 815us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048818.917829:0:18632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:3.0:1789048818.947053:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048818.947578:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097789440 00000100:00100000:0.0:1789048818.947590:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097789440 00000100:00100000:0.0:1789048818.947660:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 76 00000100:00100000:0.0:1789048818.947671:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+12:2390:x1875953097789440:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:0.0:1789048818.947705:0:19099:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777419 00000020:00010000:0.0:1789048818.947722:0:19099:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959c2a76b800: total 0 00000100:00080000:0.0:1789048818.947726:0:19099:0:(import.c:65:import_set_state_nolock()) ffff959c2a768000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048818.947762:0:19099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00100000:0.0:1789048818.947941:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a39ccd94-ab5b-4707-8ce7-49dceae587e6+11:2390:x1875953097789440:12345-192.168.202.16@tcp:39:umount.0 Request processed in 271us (913us total) trans 8589934639 rc 0/0 00000100:00100000:0.0:1789048818.947949:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 76 00000020:00010000:2.0:1789048818.949944:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959c2a76b800: total 0 00010000:00010000:2.0:1789048818.950019:0:17111:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959c2a76b800, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1789048818.950067:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:2.0:1789048818.950071:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048818.950091:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c200/0x133f221c0877753f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bcb expref: 10 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950116:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048818.950119:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789048818.950138:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3c600/0x133f221c087776ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c57 expref: 9 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950154:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff959c3ef1fc00) 00010000:00010000:2.0:1789048818.950157:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048818.950160:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061200/0x133f221c087777ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c96 expref: 8 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950319:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c05322d00) 00010000:00010000:2.0:1789048818.950323:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789048818.950327:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0200/0x133f221c087774e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bb6 expref: 7 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950708:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff959c3ef1e200) 00010000:00010000:2.0:1789048818.950711:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789048818.950716:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0e00/0x133f221c087775c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bf5 expref: 6 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950732:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff959b06bfcc00) 00010000:00010000:2.0:1789048818.950734:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048818.950738:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef3d200/0x133f221c08777745 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29c6c expref: 5 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950753:0:17111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c3ef1e700) 00010000:00010000:2.0:1789048818.950755:0:17111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048818.950758:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39200/0x133f221c08777500 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bbd expref: 4 pid: 19099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048818.950770:0:17111:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959c2a76b800, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1789048818.950797:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048818.950799:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048818.950801:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048818.970463:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048818.970717:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097789568 00000100:00100000:2.0:1789048818.970728:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097789568 00000100:00100000:2.0:1789048818.970791:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 77 00000100:00100000:2.0:1789048818.970801:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+5:2390:x1875953097789568:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789048818.970835:0:17122:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777420 00000100:00080000:2.0:1789048818.970854:0:17122:0:(import.c:65:import_set_state_nolock()) ffff959c2a76d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789048818.970915:0:17122:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789048818.971477:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a39ccd94-ab5b-4707-8ce7-49dceae587e6+3:2390:x1875953097789568:12345-192.168.202.16@tcp:39:umount.0 Request processed in 674us (1020us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789048818.971486:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 77 00010000:00010000:0.0:1789048818.976409:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048819.293614:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048819.684141:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048819.684167:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111496576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048819.684236:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048819.702006:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496576 00000100:00100000:1.0:1789048819.702020:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496576 00000100:00080000:0.0:1789048819.702112:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048819.702117:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048819.702128:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111496576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048819.702168:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048819.709371:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111496576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7237us (25125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048819.709386:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048819.713230:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111496576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048820.322148:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048820.704703:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111496704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048820.704799:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048820.705050:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496704 00000100:00100000:1.0:1789048820.705059:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496704 00000100:00100000:1.0:1789048820.705118:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789048820.705127:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111496704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048820.705163:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789048820.705222:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111496704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048820.705230:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789048820.705619:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111496704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048821.213722:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111496832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.213796:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048821.213872:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111497216:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.213904:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048821.213955:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111497728:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.213978:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048821.213994:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.214025:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048821.214050:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789048821.214067:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111497088:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.214109:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048821.214124:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111497600:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.214143:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.214305:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111496960:0@lo:400:kworker.0 00000100:00100000:0.0:1789048821.214367:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.214394:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111497472:0@lo:400:kworker.0 00000100:00100000:0.0:1789048821.214414:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.214431:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111497984:0@lo:400:kworker.0 00000100:00100000:0.0:1789048821.214450:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.214467:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111498496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048821.214486:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.214505:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048821.214510:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111498368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048821.214540:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.214586:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497728 00000100:00100000:0.0:1789048821.214593:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497728 00000100:00100000:2.0:1789048821.214665:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111498112:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.214688:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048821.220607:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497216 00000100:00100000:3.0:1789048821.220640:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497216 00000100:00100000:3.0:1789048821.220703:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497088 00000100:00100000:3.0:1789048821.220707:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497088 00000100:00100000:3.0:1789048821.220725:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497600 00000100:00100000:3.0:1789048821.220728:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497600 00000100:00100000:3.0:1789048821.220738:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497472 00000100:00100000:3.0:1789048821.220740:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497472 00000100:00100000:3.0:1789048821.220757:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048821.220766:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111497216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.220856:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111497216:12345-0@lo:400:kworker.0 Request processed in 91us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.220862:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048821.220877:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048821.220884:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111497088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.220914:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0820d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111497088:12345-0@lo:400:kworker.0 Request processed in 31us (6805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.220919:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048821.220929:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048821.220934:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.220976:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111497600:12345-0@lo:400:kworker.0 Request processed in 42us (6832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.220982:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048821.220992:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789048821.220997:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111497472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.221063:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111497472:12345-0@lo:400:kworker.0 Request processed in 66us (6648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.221070:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789048821.221125:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111497472:0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.222920:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111497344:0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.223614:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496960 00000100:00100000:1.0:1789048821.223622:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496960 00000100:00100000:1.0:1789048821.223674:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498368 00000100:00100000:1.0:1789048821.223677:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498368 00000100:00100000:1.0:1789048821.223692:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789048821.223698:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111496960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.223752:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3621:x1875953111496960:12345-0@lo:400:kworker.0 Request processed in 53us (9385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048821.223758:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789048821.223775:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048821.223780:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111498368:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789048821.223850:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048821.223856:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048821.223874:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498496 00000100:00100000:0.0:1789048821.223878:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498496 00000100:00100000:0.0:1789048821.223920:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048821.223926:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111498496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048821.223947:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789048821.223982:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111498496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (9494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048821.223995:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048821.224031:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111498624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048821.224072:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048821.224115:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498624 00000100:00100000:0.0:1789048821.224119:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498624 00000100:00100000:0.0:1789048821.224135:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048821.224140:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111498624:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:1.0:1789048821.224366:0:17128:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048821.224401:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111498368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 621us (9860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048821.224408:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048821.224453:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111498368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048821.224465:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111496960:0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.224478:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111498496:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048821.224603:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789048821.224637:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111498624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 497us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048821.224643:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048821.224673:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111498624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048821.225727:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498240 00000100:00100000:3.0:1789048821.225735:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498240 00000100:00100000:3.0:1789048821.225752:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111496832 00000100:00100000:3.0:1789048821.225755:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111496832 00000100:00100000:3.0:1789048821.225795:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789048821.225804:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3620:x1875953111496832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048821.227293:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497984 00000100:00100000:0.0:1789048821.227304:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497984 00000100:00080000:0.0:1789048821.227331:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048821.227376:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498112 00000100:00100000:0.0:1789048821.227379:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498112 00000100:00080000:0.0:1789048821.227391:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048821.227406:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789048821.227414:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111497728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.234780:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3620:x1875953111496832:12345-0@lo:400:kworker.0 Request processed in 8967us (20974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.234798:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789048821.234865:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789048821.234879:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111497984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.244388:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048821.244439:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111497856:0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.244494:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048821.244546:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111496832:0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.244718:0:17122:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789048821.244728:0:17122:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789048821.244886:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789048821.244893:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497344 00000100:00100000:1.0:1789048821.244899:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497344 00000100:00100000:1.0:1789048821.244914:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789048821.244917:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111497856 00000100:00100000:1.0:1789048821.244920:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111497856 00000100:00100000:1.0:1789048821.244932:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789048821.244938:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111497984:12345-0@lo:400:kworker.0 Request processed in 10062us (30484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048821.244938:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048821.244945:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111498112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.244946:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789048821.244963:0:17123:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789048821.244968:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789048821.244973:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111498240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.244989:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111498112:12345-0@lo:400:kworker.0 Request processed in 45us (30300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048821.244995:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789048821.244998:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111498240:12345-0@lo:400:kworker.0 Request processed in 26us (30973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.245003:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789048821.245004:0:17124:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789048821.245027:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789048821.245032:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111497344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048821.245035:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789048821.245040:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111497856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.245064:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111497344:12345-0@lo:400:kworker.0 Request processed in 32us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048821.245070:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789048821.245076:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111497856:12345-0@lo:400:kworker.0 Request processed in 36us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048821.245082:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789048821.245124:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c070a3100 x1875953111497984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048821.245135:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111497984:0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.245159:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111497344:0@lo:400:kworker.0 00000100:00100000:3.0:1789048821.245169:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111497856:0@lo:400:kworker.0 00000100:00080000:3.0:1789048821.245207:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048821.245211:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048821.245455:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111497728:12345-0@lo:400:kworker.0 Request processed in 18040us (31473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048821.245463:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789048821.245762:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111498112:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.245775:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111497216:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.245785:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111497728:0@lo:400:kworker.0 00010000:00080000:2.0:1789048821.245795:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c070a2680 x1875953111498240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048821.245803:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111498240:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.245828:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111497088:0@lo:400:kworker.0 00000100:00100000:2.0:1789048821.245838:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111497600:0@lo:400:kworker.0 00010000:00010000:2.0:1789048821.341761:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048821.917998:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048822.266119:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048822.266161:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048822.266195:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048822.266236:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048822.266268:0:17123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097790208 00000100:00100000:3.0:1789048822.266277:0:17123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097790208 00000100:00100000:0.0:1789048822.266302:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097789696 00000100:00100000:0.0:1789048822.266308:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097789696 00000100:00080000:3.0:1789048822.266313:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048822.266391:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097789952 00000100:00100000:0.0:1789048822.266395:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097789952 00000100:00100000:0.0:1789048822.266408:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097789824 00000100:00100000:0.0:1789048822.266411:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097789824 00000100:00100000:0.0:1789048822.266426:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048822.266434:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d991937-03b3-45a3-961b-b41aa0369386+12:2392:x1875953097789696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048822.266450:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048822.266469:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07060c00/0x133f221c08777443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b38 expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048822.266487:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048822.266551:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d991937-03b3-45a3-961b-b41aa0369386+11:2392:x1875953097789696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 117us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048822.266559:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048822.266576:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048822.266582:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d991937-03b3-45a3-961b-b41aa0369386+10:2392:x1875953097789952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048822.266590:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048822.266600:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38000/0x133f221c087774c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ba8 expref: 10 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048822.266610:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048822.266628:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d991937-03b3-45a3-961b-b41aa0369386+9:2392:x1875953097789952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 47us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048822.266634:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048822.266646:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789048822.266652:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d991937-03b3-45a3-961b-b41aa0369386+8:2392:x1875953097789824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048822.266659:0:17109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048822.266674:0:17109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1200/0x133f221c0877744a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29b69 expref: 8 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048822.266690:0:17109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048822.266710:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d991937-03b3-45a3-961b-b41aa0369386+7:2392:x1875953097789824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 58us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048822.266716:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1789048822.266788:0:17123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 78 00000100:00100000:3.0:1789048822.266799:0:17123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+6:2390:x1875953097790208:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:3.0:1789048822.266836:0:17123:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777458 00000020:00010000:3.0:1789048822.266847:0:17123:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959c2a769000: total 0 00000100:00080000:3.0:1789048822.266851:0:17123:0:(import.c:65:import_set_state_nolock()) ffff959c2a76e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789048822.269230:0:17123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934639 00000100:00100000:3.0:1789048822.270090:0:17123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2390:x1875953097790208:12345-192.168.202.16@tcp:39:umount.0 Request processed in 3288us (3847us total) trans 8589934640 rc 0/0 00000100:00100000:3.0:1789048822.270103:0:17123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 78 00000020:00010000:0.0:1789048822.280139:0:17110:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959c2a769000: total 0 00010000:00010000:0.0:1789048822.280149:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048822.280351:0:17110:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959c2a769000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789048822.280392:0:17110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959b06bfcd00) 00010000:00010000:0.0:1789048822.280396:0:17110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048822.280407:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba0600/0x133f221c0877754d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29bd2 expref: 4 pid: 17123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048822.280437:0:17110:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959c2a769000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789048822.280449:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048822.280451:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048822.280453:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048822.316248:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048822.316376:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097790336 00000100:00100000:0.0:1789048822.316386:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097790336 00000100:00100000:0.0:1789048822.316468:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 79 00000100:00100000:0.0:1789048822.316480:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+5:2390:x1875953097790336:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:0.0:1789048822.316531:0:19099:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877745f 00000100:00080000:0.0:1789048822.316541:0:19099:0:(import.c:65:import_set_state_nolock()) ffff959c1069b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048822.316603:0:19099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1789048822.316755:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e75ca1a9-3972-4d73-931e-9ff32f454dcc+3:2390:x1875953097790336:12345-192.168.202.16@tcp:39:umount.0 Request processed in 277us (516us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789048822.316777:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 79 00010000:00010000:2.0:1789048822.317073:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048822.318378:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789048822.365915:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048822.419733:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048822.423472:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097790592 00000100:00100000:3.0:1789048822.423507:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097790592 00000100:00100000:3.0:1789048822.423591:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:3.0:1789048822.423603:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+7:2390:x1875953097790592:12345-192.168.202.16@tcp:251:umount.0 00000020:00000080:3.0:1789048822.423657:0:17115:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087773f6 00000020:00010000:3.0:1789048822.423665:0:17115:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959b0693d800: total 0 00000100:00080000:3.0:1789048822.423669:0:17115:0:(import.c:65:import_set_state_nolock()) ffff959b0693c000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789048822.423747:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5d991937-03b3-45a3-961b-b41aa0369386+3:2390:x1875953097790592:12345-192.168.202.16@tcp:251:umount.0 Request processed in 146us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048822.423754:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 178 00000020:00010000:2.0:1789048822.424199:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959b0693d800: total 0 00010000:00010000:2.0:1789048822.424256:0:17111:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959b0693d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789048822.424291:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38200/0x133f221c087773fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ac1 expref: 2 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048822.424304:0:17111:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959b0693d800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789048822.424314:0:17111:0:(genops.c:885:class_export_put()) final put ffff959b0693d800/5d991937-03b3-45a3-961b-b41aa0369386 00010000:00010000:2.0:1789048822.424328:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048822.424407:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048822.424409:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789048822.426657:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0693d800/5d991937-03b3-45a3-961b-b41aa0369386 for MGS 00000020:00000080:3.0:1789048822.426717:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b0693c000 for MGS 00010000:00010000:3.0:1789048823.389664:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048823.775406:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111498752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048823.775464:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048823.775507:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498752 00000100:00100000:3.0:1789048823.775516:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498752 00000100:00100000:3.0:1789048823.775578:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048823.775589:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111498752:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789048823.775600:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789048823.775618:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048823.775663:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111498752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048823.777251:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048823.777427:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111498752:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789048824.097505:0:17157:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789048824.097515:0:17157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048824.097537:0:17157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789048824.097543:0:17157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:01000004:0.0:1789048824.273125:0:20694:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000001:00100000:1.0:1789048824.287570:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000020:00000080:1.0:1789048824.287579:0:19445:0:(genops.c:885:class_export_put()) final put ffff959b08c24800/a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000020:00000080:3.0:1789048824.287648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08c24800/a39ccd94-ab5b-4707-8ce7-49dceae587e6 for lustre-OST0001 00000020:00000080:3.0:1789048824.287701:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b06939000 for lustre-OST0001 00000020:01000004:0.0:1789048824.295652:0:20694:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789048824.295707:0:20694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.295721:0:20694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.295729:0:20694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.295736:0:20694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.295761:0:20694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048824.295766:0:20694:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789048824.295790:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048824.295795:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789048824.295839:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048824.295846:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048824.295854:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c04cb1c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048824.295858:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048824.295866:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048824.295873:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048824.295880:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789048824.295882:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789048824.295884:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789048824.295921:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048824.295928:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1789048824.295930:0:20694:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789048824.295944:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c2b600800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789048824.295950:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048824.295968:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c04cb1c00/0x133f221c08776fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776fc0 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048824.295991:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048824.295993:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048824.295994:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048824.296011:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048824.296040:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111498880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048824.296113:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048824.296740:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111499008:0@lo:39:umount.0 00000100:00100000:2.0:1789048824.296782:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048824.296907:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111498880 00000100:00100000:0.0:1789048824.296915:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111498880 00000100:00100000:0.0:1789048824.296963:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048824.296992:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c04cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3621:x1875953111498880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048824.297006:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048824.297021:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364000/0x133f221c08776fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08776fb9 expref: 24 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.297044:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048824.297086:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c04cb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:3621:x1875953111498880:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048824.297092:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789048824.297741:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111498880:0@lo:103:ldlm_bl.0 00000001:00100000:0.0:1789048824.299249:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00080000:0.0:1789048824.299267:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934640 is committed 00000020:00000080:0.0:1789048824.299274:0:17102:0:(genops.c:885:class_export_put()) final put ffff959c2a769000/e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00100000:0.0:1789048824.299296:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000001:00080000:0.0:1789048824.299302:0:17102:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934639 is committed 00000020:00000080:0.0:1789048824.299305:0:17102:0:(genops.c:885:class_export_put()) final put ffff959c2a76b800/a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000020:00000080:3.0:1789048824.299926:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2a769000/e75ca1a9-3972-4d73-931e-9ff32f454dcc for lustre-MDT0000 00000020:00000080:3.0:1789048824.300007:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2a76e800 for lustre-MDT0000 00000020:00000080:2.0:1789048824.300195:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2a76b800/a39ccd94-ab5b-4707-8ce7-49dceae587e6 for lustre-MDT0000 00000020:00000080:2.0:1789048824.300239:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2a768000 for lustre-MDT0000 00000100:00100000:1.0:1789048824.300695:0:20608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499008 00000100:00100000:1.0:1789048824.300705:0:20608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499008 00000100:00100000:1.0:1789048824.300807:0:20608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789048824.300818:0:20608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875953111499008:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789048824.300847:0:20608:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776fea 00000100:00080000:1.0:1789048824.300857:0:20608:0:(import.c:65:import_set_state_nolock()) ffff959c33596800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789048824.300969:0:20608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3619:x1875953111499008:12345-0@lo:39:umount.0 Request processed in 153us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048824.300988:0:20608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1789048824.300998:0:20608:0:(genops.c:885:class_export_put()) final put ffff959c33597000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789048824.301049:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048824.301108:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2b600800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789048824.301119:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111499008:0@lo:39:umount.0 00000100:00080000:0.0:1789048824.301144:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048824.301147:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789048824.301152:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789048824.302134:0:20694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302150:0:20694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302157:0:20694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302190:0:20694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302210:0:20694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048824.302217:0:20694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302224:0:20694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302230:0:20694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302236:0:20694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302248:0:20694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048824.302255:0:20694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302262:0:20694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302268:0:20694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302274:0:20694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302293:0:20694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789048824.302299:0:20694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302306:0:20694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302313:0:20694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302319:0:20694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048824.302326:0:20694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789048824.302329:0:20694:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789048824.302385:0:20694:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789048824.302389:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789048824.302393:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048824.302399:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:0.0:1789048824.302405:0:20694:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959c2a76f800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048824.302411:0:20694:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959b08a4c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048824.302415:0:20694:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959c08ad8800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048824.302419:0:20694:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff959c2aea3000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048824.302424:0:20694:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff959b077e99c0) has exports, disconnecting them 00000020:00080000:0.0:1789048824.302428:0:20694:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959c2a76f800), last request at 1789048821 00000020:00000080:0.0:1789048824.302434:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087772e5 00000100:00080000:0.0:1789048824.302452:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c2a76a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789048824.302502:0:20694:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c2a76f800): rc 0 00000020:00000080:0.0:1789048824.302504:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2a76f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789048824.302510:0:20694:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959b08a4c000), last request at 1789048821 00000020:00000080:0.0:1789048824.302512:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777187 00000100:00080000:0.0:1789048824.302517:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959b08a49000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789048824.302522:0:20694:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b08a4c000): rc 0 00000020:00000080:0.0:1789048824.302524:0:20694:0:(genops.c:885:class_export_put()) final put ffff959b08a4c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789048824.302527:0:20694:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959c08ad8800), last request at 1789048738 00000020:00000080:0.0:1789048824.302530:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087770d8 00000100:00080000:0.0:1789048824.302532:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c08adf000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789048824.302537:0:20694:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c08ad8800): rc 0 00000020:00000080:0.0:1789048824.302538:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c08ad8800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789048824.302542:0:20694:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff959c2aea3000), last request at 1789048738 00000020:00000080:0.0:1789048824.302545:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877707d 00000100:00080000:0.0:1789048824.302548:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c414c6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048824.302554:0:20694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934640 00000020:00080000:0.0:1789048824.302633:0:20694:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c2aea3000): rc 0 00000004:00000080:0.0:1789048824.302639:0:20694:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb770c858fae0 00000100:00080000:0.0:1789048824.302660:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048824.302663:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789048824.303525:0:20694:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789048824.303550:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789048824.303589:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111499136:0@lo:39:umount.0 00000100:00100000:0.0:1789048824.303648:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048824.303769:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789048824.303785:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303794:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048824.303798:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303807:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048824.303815:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048824.303820:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789048824.303823:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789048824.303826:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789048824.303850:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303857:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048824.303886:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303894:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d800/0x133f221c08776f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776f11 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303908:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789048824.303911:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303917:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061400 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048824.303927:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303934:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048824.303941:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048824.303946:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789048824.303948:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789048824.303950:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789048824.303962:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.303968:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048824.303997:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304005:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c0877731d expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304014:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048824.304018:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304023:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048824.304026:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304032:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048824.304045:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048824.304050:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789048824.304052:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789048824.304054:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789048824.304069:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304074:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048824.304080:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304086:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087774b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087774ba expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304096:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048824.304099:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304106:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3cc00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048824.304109:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304116:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048824.304123:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048824.304139:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789048824.304142:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789048824.304144:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789048824.304173:0:17111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304180:0:17111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048824.304186:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304193:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3cc00/0x133f221c08776efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08776f03 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304204:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048824.304206:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048824.304207:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048824.304219:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111499648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048824.304292:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789048824.304299:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111499264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304319:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048824.304369:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111499392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304391:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048824.304408:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048824.304413:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111499520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304430:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048824.304456:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499648 00000100:00100000:3.0:1789048824.304468:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499648 00000100:00100000:3.0:1789048824.304509:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499264 00000100:00100000:3.0:1789048824.304512:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499264 00000100:00100000:3.0:1789048824.304524:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499392 00000100:00100000:3.0:1789048824.304526:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499392 00000100:00100000:3.0:1789048824.304535:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499520 00000100:00100000:3.0:1789048824.304537:0:17108:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499520 00000100:00100000:3.0:1789048824.304554:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048824.304563:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+26:3620:x1875953111499648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048824.304576:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048824.304588:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08365400/0x133f221c08776f03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08776efc expref: 26 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304600:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048824.304630:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+25:3620:x1875953111499648:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048824.304637:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789048824.304652:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048824.304657:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+24:3620:x1875953111499264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048824.304664:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048824.304672:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364e00/0x133f221c08776f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08776f0a expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304680:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048824.304698:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+23:3620:x1875953111499264:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048824.304703:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048824.304714:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048824.304718:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+22:3622:x1875953111499392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048824.304730:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048824.304738:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061600/0x133f221c0877731d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08777316 expref: 22 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304746:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048824.304769:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+21:3622:x1875953111499392:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048824.304775:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048824.304787:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048824.304793:0:17108:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+20:3622:x1875953111499520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048824.304800:0:17108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048824.304807:0:17108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1e00/0x133f221c087774ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087774b3 expref: 20 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048824.304817:0:17108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048824.304836:0:17108:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3622:x1875953111499520:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048824.304842:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1789048824.304862:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048824.304885:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111499520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304893:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0810ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3622:1875953111499392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304920:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111499264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048824.304927:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111499648:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789048824.305632:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789048824.305639:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789048824.305686:0:20694:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789048824.305747:0:20694:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789048824.305774:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789048824.305854:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499136 00000100:00100000:1.0:1789048824.305861:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499136 00000100:00100000:1.0:1789048824.305900:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789048824.305908:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875953111499136:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789048824.305934:0:17128:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777102 00000100:00080000:1.0:1789048824.305941:0:17128:0:(import.c:65:import_set_state_nolock()) ffff959b08338800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789048824.305961:0:17128:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789048824.306170:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111499776:0@lo:9:umount.0 00000100:00100000:2.0:1789048824.306209:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048824.306257:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789048824.306260:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789048824.306281:0:20694:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789048824.306378:0:20694:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789048824.306390:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789048824.306507:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499776 00000100:00100000:3.0:1789048824.306512:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499776 00000100:00100000:3.0:1789048824.306550:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048824.306557:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875953111499776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789048824.306574:0:18912:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087771cd 00000100:00080000:3.0:1789048824.306580:0:18912:0:(import.c:65:import_set_state_nolock()) ffff959b076eb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789048824.306610:0:18912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789048824.307156:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3619:x1875953111499136:12345-0@lo:39:umount.0 Request processed in 1247us (3505us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789048824.307166:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000001:00100000:1.0:1789048824.308381:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789048824.308392:0:17856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1789048824.308396:0:17856:0:(genops.c:885:class_export_put()) final put ffff959b0833d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789048824.308404:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00080000:1.0:1789048824.308409:0:17856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1789048824.308411:0:17856:0:(genops.c:885:class_export_put()) final put ffff959b0693b000/e75ca1a9-3972-4d73-931e-9ff32f454dcc 00000001:00100000:1.0:1789048824.308416:0:17856:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000001:00080000:1.0:1789048824.308421:0:17856:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1789048824.308423:0:17856:0:(genops.c:885:class_export_put()) final put ffff959c2a76f000/a39ccd94-ab5b-4707-8ce7-49dceae587e6 00000020:00000080:1.0:1789048824.308436:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c33597000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789048824.308481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2a76f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789048824.308499:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08a4c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789048824.308518:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08ad8800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789048824.308540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0833d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789048824.308564:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0693b000/e75ca1a9-3972-4d73-931e-9ff32f454dcc for lustre-MDT0001 00000020:00000080:1.0:1789048824.308586:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2a76f000/a39ccd94-ab5b-4707-8ce7-49dceae587e6 for lustre-MDT0001 00000020:00000080:1.0:1789048824.308608:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c33596800 for lustre-MDT0000 00000020:00000080:1.0:1789048824.308612:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2a76a000 for lustre-MDT0000 00000020:00000080:1.0:1789048824.308615:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08a49000 for lustre-MDT0000 00000020:00000080:1.0:1789048824.308618:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c08adf000 for lustre-MDT0000 00000020:00000080:1.0:1789048824.308621:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08338800 for lustre-MDT0001 00000020:00000080:1.0:1789048824.308624:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c1069b000 for lustre-MDT0001 00000020:00000080:1.0:1789048824.308627:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2a76d000 for lustre-MDT0001 00010000:00010000:1.0:1789048824.308640:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789048824.308900:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff959b077e99c0) has no exports 00000100:00080000:2.0:1789048824.309092:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c03136800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789048824.309102:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111499136:0@lo:39:umount.0 00000100:00100000:2.0:1789048824.309122:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111499904:0@lo:9:umount.0 00000100:00100000:2.0:1789048824.309179:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048824.309244:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111499904 00000100:00100000:0.0:1789048824.309250:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111499904 00000100:00100000:0.0:1789048824.309291:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789048824.309299:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875953111499904:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789048824.309355:0:18630:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777324 00000100:00080000:0.0:1789048824.309363:0:18630:0:(import.c:65:import_set_state_nolock()) ffff959c05307000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789048824.309396:0:18630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1789048824.309510:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3619:x1875953111499904:12345-0@lo:9:umount.0 Request processed in 211us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048824.309518:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048824.309717:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3619:x1875953111499776:12345-0@lo:9:umount.0 Request processed in 3160us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048824.309724:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1789048824.309748:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048824.309877:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048824.310447:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789048824.310492:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789048824.310510:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789048824.310513:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048824.310516:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111499776:0@lo:9:umount.0 00000100:00080000:2.0:1789048824.310544:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2ac8e800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789048824.310587:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789048824.310754:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048824.310758:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111499904:0@lo:9:umount.0 00000020:00080000:0.0:1789048824.315633:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff959b077e99c0) has no exports 00000020:00000080:0.0:1789048824.358766:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f57 00000020:00000080:0.0:1789048824.358784:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2effb000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789048824.358811:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789048824.359010:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048824.359020:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789048824.359024:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff959b07920000) has no exports 00000020:00000080:1.0:1789048824.360126:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2effb000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789048824.360186:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f50 00000020:00000080:2.0:1789048824.360192:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3e9da800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789048824.360240:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048824.360247:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789048824.360249:0:20694:0:(genops.c:885:class_export_put()) final put ffff959b08802800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789048824.360250:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08802800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789048824.360256:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789048824.360432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3e9da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789048824.413755:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048824.798316:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111500032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048824.798428:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048824.798661:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500032 00000100:00100000:3.0:1789048824.798671:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500032 00000100:00100000:3.0:1789048824.798750:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048824.798762:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111500032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048824.798787:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1789048824.798857:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048824.803420:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111500032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4648us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048824.803437:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789048824.809124:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111500032:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789048825.440211:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048825.822754:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111500160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048825.822836:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048825.822961:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500160 00000100:00100000:0.0:1789048825.822978:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500160 00000100:00100000:0.0:1789048825.823026:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789048825.823034:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875953111500160:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789048825.823055:0:18100:0:(tgt_handler.c:811:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789048825.823106:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875953111500160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (270us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789048825.823114:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:02020000:2.0:1789048825.823194:0:3622:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789048825.833150:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789048825.833159:0:3622:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789048825.833164:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789048825.850412:0:3622:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048825.850423:0:3622:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:2.0:1789048825.850455:0:3622:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c414c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048825.850498:0:3622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08841500 x1875953111500288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048825.851722:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111500288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789048825.851789:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048825.852874:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500288 00000100:00100000:2.0:1789048825.852948:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500288 00000100:00100000:2.0:1789048825.853009:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789048825.853018:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111500288:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789048825.853036:0:17127:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789048825.874851:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111500288:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 21823us (23052us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048825.874898:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789048825.877111:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048825.877123:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048825.877128:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111500288:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789048826.333732:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111500416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048826.333805:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048826.334420:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500416 00000100:00100000:1.0:1789048826.334429:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500416 00000100:00100000:1.0:1789048826.334484:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789048826.334494:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111500416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048826.334535:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048826.334583:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111500416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048826.334590:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789048826.334611:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048826.334642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048826.334646:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789048826.334649:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048826.334654:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 580 00000100:00080000:1.0:1789048826.334657:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789048826.334664:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c414c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048826.334696:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c070a2a00 x1875953111500672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048826.334930:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111500672:0@lo:38:kworker.0 00000100:00100000:0.0:1789048826.334984:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048826.335025:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335052:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048826.335070:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111501312:0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335093:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048826.335108:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048826.335114:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111500544:0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335140:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048826.335162:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111501184:0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335181:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048826.335205:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500800 00000100:00100000:0.0:1789048826.335209:0:18630:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500800 00000100:00100000:0.0:1789048826.335243:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048826.335250:0:18630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111500800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335285:0:18630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c323e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111500800:12345-0@lo:400:kworker.0 Request processed in 36us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048826.335306:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048826.335324:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501312 00000100:00100000:0.0:1789048826.335328:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501312 00000100:00100000:0.0:1789048826.335367:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501184 00000100:00100000:0.0:1789048826.335370:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501184 00000100:00100000:0.0:1789048826.335387:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048826.335394:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111501184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335423:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111501184:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048826.335429:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789048826.335440:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789048826.335444:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1875953111501312:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789048826.335449:0:19099:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789048826.335471:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3621:x1875953111501312:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789048826.335477:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789048826.335491:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048826.335494:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789048826.335811:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c070a1c00 x1875953111501184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048826.335827:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111501184:0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.335843:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111500800:0@lo:400:kworker.0 00000100:00080000:0.0:1789048826.335852:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789048826.335856:0:3621:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789048826.335859:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789048826.335869:0:3621:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048826.335873:0:3621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 529 00000100:00080000:0.0:1789048826.335879:0:3621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b07620000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048826.335908:0:3621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080e4e00 x1875953111501568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048826.335927:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3621:1875953111501312:0@lo:400:kworker.0 00000100:00100000:1.0:1789048826.336397:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500544 00000100:00100000:1.0:1789048826.336403:0:17116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500544 00000100:00100000:1.0:1789048826.336437:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789048826.336444:0:17116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3621:x1875953111500544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048826.336485:0:17116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3621:x1875953111500544:12345-0@lo:400:kworker.0 Request processed in 41us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048826.336490:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789048826.336639:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111500544:0@lo:400:kworker.0 00000100:00100000:0.0:1789048826.336661:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111501568:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789048826.337648:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500672 00000100:00100000:1.0:1789048826.337657:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500672 00000100:00100000:0.0:1789048826.337794:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048826.337858:0:20608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501568 00000100:00100000:0.0:1789048826.337862:0:20608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501568 00000100:00100000:0.0:1789048826.337900:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789048826.337906:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111501568:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789048826.337921:0:19099:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789048826.338099:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111500928:0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.338138:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048826.338161:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111500928 00000100:00100000:3.0:1789048826.338165:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111500928 00000100:00100000:3.0:1789048826.338186:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789048826.338191:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875953111500928:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789048826.338206:0:17122:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789048826.338230:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875953111500928:12345-0@lo:400:kworker.0 Request processed in 38us (92us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789048826.338237:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789048826.338267:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789048826.338271:0:3622:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789048826.338274:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789048826.338278:0:3622:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048826.338281:0:3622:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1789048826.338290:0:3622:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959b081c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048826.338316:0:3622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c31179f80 x1875953111501696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048826.338354:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111500928:0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.338364:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c31179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111501696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789048826.338385:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048826.338408:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501696 00000100:00100000:3.0:1789048826.338411:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501696 00000100:00100000:3.0:1789048826.338426:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789048826.338430:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111501696:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789048826.338439:0:17122:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789048826.338479:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111501696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 47us (93us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048826.338485:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1789048826.338507:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048826.338511:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048826.338601:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c31179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111501696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789048826.338625:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111501440:0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.338649:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048826.338667:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501440 00000100:00100000:3.0:1789048826.338670:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501440 00000100:00100000:1.0:1789048826.338925:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789048826.338931:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111500672:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1789048826.339017:0:17128:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789048826.339053:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111500672:12345-0@lo:38:kworker.0 Request processed in 121us (4069us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048826.339060:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789048826.339122:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789048826.339128:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111501440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.339162:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111501440:12345-0@lo:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048826.339168:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789048826.339196:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048826.339200:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048826.339204:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111500672:0@lo:38:kworker.0 00010000:00080000:3.0:1789048826.339228:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c070a0700 x1875953111501440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048826.339239:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111501440:0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.339253:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048826.339259:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111501056:0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.339281:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048826.339297:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501056 00000100:00100000:3.0:1789048826.339300:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501056 00000100:00100000:3.0:1789048826.339315:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789048826.339319:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875953111501056:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789048826.339324:0:17122:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789048826.339364:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875953111501056:12345-0@lo:400:kworker.0 Request processed in 43us (82us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789048826.339378:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789048826.339402:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789048826.339405:0:3622:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789048826.339408:0:3622:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789048826.339413:0:3622:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048826.339416:0:3622:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 512 00000100:00080000:3.0:1789048826.339422:0:3622:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c08adc000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048826.339439:0:3622:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c31179c00 x1875953111501824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048826.339455:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111501056:0@lo:400:kworker.0 00000100:00100000:3.0:1789048826.339465:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c31179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111501824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789048826.339486:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048826.339507:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501824 00000100:00100000:3.0:1789048826.339511:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501824 00000100:00080000:1.0:1789048826.339665:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048826.340297:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789048826.340304:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111501824:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1789048826.340318:0:17122:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789048826.340394:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111501824:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 89us (906us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048826.340400:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789048826.340430:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048826.340435:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048826.340438:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c31179c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111501824:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789048826.340592:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111500416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048826.357671:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111501568:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 19752us (19866us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048826.358495:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789048826.358698:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048826.358721:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048826.358725:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111501568:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1789048826.462242:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048827.489974:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048828.510378:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048829.535479:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048829.918095:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048829.918120:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111501952:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048829.918204:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048829.918457:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111501952 00000100:00100000:1.0:1789048829.918466:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111501952 00000100:00100000:1.0:1789048829.918536:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789048829.918546:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111501952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048829.918589:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048829.918638:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111501952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048829.918646:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789048829.918721:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048829.919490:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111501952:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789048830.435445:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789048830.435456:0:19445:0:(genops.c:885:class_export_put()) final put ffff959c05303000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789048830.435689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c05303000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789048830.435760:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c05307000 for lustre-OST0001 00000001:00100000:2.0:1789048830.435870:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789048830.435875:0:18626:0:(genops.c:885:class_export_put()) final put ffff959b076ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789048830.436008:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b076ec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789048830.436037:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b076eb800 for lustre-OST0000 00000001:00100000:0.0:1789048830.436659:0:17102:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048830.436664:0:17102:0:(genops.c:885:class_export_put()) final put ffff959c2aea3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789048830.436726:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2aea3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789048830.436770:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c414c6000 for lustre-MDT0000 00010000:00010000:3.0:1789048830.559185:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048831.134782:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048831.453822:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111502080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048831.454008:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111502208:0@lo:400:kworker.0 00000100:00100000:3.0:1789048831.454558:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048831.456254:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048831.457081:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502208 00000100:00100000:2.0:1789048831.457093:0:17115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502208 00000100:00100000:2.0:1789048831.457145:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789048831.457155:0:17115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c32918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3621:x1875953111502208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048831.460265:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502080 00000100:00100000:3.0:1789048831.460282:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502080 00000100:00100000:3.0:1789048831.460385:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048831.460396:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111502080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048831.460432:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789048831.460514:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111502080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (5958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048831.460522:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048831.460598:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111502080:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789048831.460639:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048831.461151:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048831.461157:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048831.461174:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048831.461194:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 581 00000100:00080000:0.0:1789048831.461199:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789048831.461210:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c414c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048831.461248:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080e6300 x1875953111502336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048831.461279:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111502336:0@lo:38:kworker.0 00000100:00100000:0.0:1789048831.461320:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048831.461420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048831.461424:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048831.461427:0:37:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048831.461431:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 581 00000100:00080000:0.0:1789048831.461434:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048831.461440:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959b081c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048831.461446:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502336 00000100:00100000:3.0:1789048831.461453:0:17127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502336 00000100:00100000:0.0:1789048831.461454:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111502464:0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.461485:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048831.461495:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789048831.461511:0:17127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111502336:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789048831.461520:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502464 00000100:00100000:0.0:1789048831.461524:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502464 00010000:02000000:3.0:1789048831.461528:0:17127:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048831.461560:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789048831.461578:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111502464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.461613:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111502464:12345-0@lo:400:kworker.0 Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048831.461619:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789048831.461634:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048831.461649:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111502464:0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.461681:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080e7b80 x1875953111502592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048831.461695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048831.461697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048831.461699:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048831.461703:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 581 00000100:00080000:0.0:1789048831.461705:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048831.461710:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c08adc000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048831.461718:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111502592:0@lo:38:kworker.0 00000100:00100000:0.0:1789048831.461743:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048831.461772:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080e6d80 x1875953111502720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048831.461788:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111502720:0@lo:38:kworker.0 00000100:00100000:0.0:1789048831.461808:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048831.461829:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502592 00000100:00100000:0.0:1789048831.461833:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502592 00000100:00100000:0.0:1789048831.461849:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502720 00000100:00100000:0.0:1789048831.461851:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502720 00000100:00100000:0.0:1789048831.461863:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789048831.461868:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111502592:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789048831.461877:0:17122:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048831.461905:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111502592:12345-0@lo:38:kworker.0 Request processed in 36us (161us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048831.461922:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789048831.461933:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789048831.461938:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111502720:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789048831.461950:0:17122:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048831.461972:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111502720:12345-0@lo:38:kworker.0 Request processed in 34us (164us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048831.461978:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789048831.461998:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048831.462002:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048831.462004:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111502720:0@lo:38:kworker.0 00000100:00080000:0.0:1789048831.462011:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048831.462014:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048831.462017:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111502592:0@lo:38:kworker.0 00000100:00080000:0.0:1789048831.462041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048831.462044:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048831.462046:0:37:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048831.462049:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 581 00000100:00080000:0.0:1789048831.462052:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048831.462554:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b07620000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048831.462565:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048831.462573:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111502848:0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.462600:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048831.462625:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502848 00000100:00100000:0.0:1789048831.462628:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502848 00000100:00100000:0.0:1789048831.462654:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789048831.462661:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111502848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.462692:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111502848:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048831.462708:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1789048831.462722:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789048831.462739:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e7b80 x1875953111502848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048831.462749:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111502848:0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.462772:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080e7b80 x1875953111502976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048831.462792:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111502976:0@lo:38:kworker.0 00000100:00100000:0.0:1789048831.462813:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048831.462831:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111502976 00000100:00100000:0.0:1789048831.462834:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111502976 00000100:00100000:0.0:1789048831.462847:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789048831.462851:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111502976:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789048831.462860:0:19099:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048831.462882:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111502976:12345-0@lo:38:kworker.0 Request processed in 30us (69us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048831.462888:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1789048831.462906:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048831.462921:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048831.462925:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111502976:0@lo:38:kworker.0 00000100:00100000:2.0:1789048831.466681:0:17115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c32918c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3621:x1875953111502208:12345-0@lo:400:kworker.0 Request processed in 9522us (10424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048831.466696:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789048831.466876:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111503104:0@lo:400:kworker.0 00000100:00100000:0.0:1789048831.466942:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048831.467067:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503104 00000100:00100000:2.0:1789048831.467075:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503104 00000100:00100000:2.0:1789048831.467134:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789048831.467142:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111503104:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789048831.467447:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048831.467664:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111503104:12345-0@lo:400:kworker.0 Request processed in 523us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048831.467672:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1789048831.467705:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080e7b80 x1875953111503104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048831.467718:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111503104:0@lo:400:kworker.0 00000100:00100000:1.0:1789048831.468528:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111502208:0@lo:400:kworker.0 00000100:00100000:3.0:1789048831.473543:0:17127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111502336:12345-0@lo:38:kworker.0 Request processed in 12027us (12216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048831.473558:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789048831.474473:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048831.474482:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048831.474486:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111502336:0@lo:38:kworker.0 00010000:00010000:2.0:1789048831.584696:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048832.607836:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048833.630478:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048834.655854:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048835.037572:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048835.037595:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111503232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048835.037665:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048835.037865:0:18634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503232 00000100:00100000:3.0:1789048835.037887:0:18634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503232 00000100:00100000:3.0:1789048835.037956:0:18634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789048835.037966:0:18634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111503232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789048835.037991:0:18634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048835.038363:0:18634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111503232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 398us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048835.038370:0:18634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048835.038452:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111503232:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789048835.039241:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789048835.678659:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048836.573739:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1789048836.573783:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048836.573788:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789048836.573791:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048836.573798:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1789048836.573803:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789048836.573814:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c414c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048836.573827:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111503360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048836.573835:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080d9500 x1875953111503616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048836.573908:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789048836.573911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048836.573914:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789048836.573916:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048836.573919:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1789048836.573922:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048836.573926:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959b081c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048836.573937:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a3100 x1875953111504000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048836.573945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048836.573961:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789048836.573963:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789048836.573965:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111503488:0@lo:400:kworker.0 00000100:00080000:2.0:1789048836.573967:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1789048836.573969:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048836.573974:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c08adc000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048836.573986:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a1f80 x1875953111504128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048836.573995:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789048836.574001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789048836.574003:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789048836.574005:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048836.574008:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1789048836.574011:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048836.574014:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b07620000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048836.574018:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048836.574023:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111504256:0@lo:400:kworker.0 00000100:00100000:2.0:1789048836.574023:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a1c00 x1875953111504384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048836.574046:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048836.574049:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111503744:0@lo:400:kworker.0 00000100:00100000:3.0:1789048836.574065:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111504512:0@lo:400:kworker.0 00000100:00100000:2.0:1789048836.574077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048836.574083:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048836.574094:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048836.574099:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111503872:0@lo:400:kworker.0 00000100:00100000:3.0:1789048836.574110:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503488 00000100:00100000:3.0:1789048836.574117:0:17117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503488 00000100:00100000:2.0:1789048836.574117:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048836.574156:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503360 00000100:00100000:2.0:1789048836.574160:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503360 00000100:00100000:3.0:1789048836.574164:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789048836.574171:0:17117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3291ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3623:x1875953111503488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048836.574196:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789048836.574216:0:17117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3291ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41c76bec-8493-4b0e-a7d0-3ca4d71b9234+19:3623:x1875953111503488:12345-0@lo:400:kworker.0 Request processed in 46us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048836.574223:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789048836.574256:0:20608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504256 00000100:00100000:3.0:1789048836.574259:0:20608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504256 00000100:00100000:2.0:1789048836.574283:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111503360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048836.574307:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789048836.574379:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111503360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 177us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048836.574385:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789048836.574399:0:20608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504512 00000100:00100000:3.0:1789048836.574403:0:20608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504512 00000100:00100000:2.0:1789048836.574405:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503744 00000100:00100000:2.0:1789048836.574407:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503744 00000100:00100000:3.0:1789048836.574423:0:20608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789048836.574423:0:18912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503872 00000100:00100000:2.0:1789048836.574425:0:18912:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503872 00000100:00100000:3.0:1789048836.574429:0:20608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111504256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048836.574440:0:18912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789048836.574446:0:18912:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111503744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048836.574459:0:20608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111504256:12345-0@lo:400:kworker.0 Request processed in 31us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048836.574465:0:20608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789048836.574477:0:20608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789048836.574481:0:20608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111504512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048836.574508:0:20608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111504512:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048836.574514:0:20608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:3.0:1789048836.574554:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a2300 x1875953111504512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048836.574560:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111503616:0@lo:38:kworker.0 00000100:00100000:3.0:1789048836.574567:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111504512:0@lo:400:kworker.0 00010000:00080000:3.0:1789048836.574577:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080a0a80 x1875953111504256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048836.574584:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111504256:0@lo:400:kworker.0 00000100:00100000:0.0:1789048836.574597:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048836.574601:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111503488:0@lo:400:kworker.0 00000100:00100000:3.0:1789048836.574614:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111503360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048836.574616:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111504000:0@lo:38:kworker.0 00000100:00100000:0.0:1789048836.574634:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048836.574649:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111504128:0@lo:38:kworker.0 00000100:00080000:3.0:1789048836.574652:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048836.574656:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048836.574668:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048836.574679:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504000 00000100:00100000:0.0:1789048836.574681:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111504384:0@lo:38:kworker.0 00000100:00100000:3.0:1789048836.574682:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504000 00000100:00100000:3.0:1789048836.574698:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504128 00000100:00100000:3.0:1789048836.574700:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504128 00000100:00100000:0.0:1789048836.574700:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048836.574708:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504384 00000100:00100000:3.0:1789048836.574710:0:17122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504384 00000100:00100000:3.0:1789048836.574718:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789048836.574723:0:17122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111504000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789048836.574726:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789048836.574733:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111503872:12345-0@lo:400:kworker.0 00010000:02000000:3.0:1789048836.574735:0:17122:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048836.574764:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111503872:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048836.574769:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789048836.574792:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111503616 00000100:00100000:0.0:1789048836.574795:0:17128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111503616 00000100:00100000:0.0:1789048836.574815:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789048836.574819:0:17128:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111503616:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789048836.574827:0:17128:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048836.574884:0:17128:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111503616:12345-0@lo:38:kworker.0 Request processed in 63us (286us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048836.574892:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789048836.574912:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789048836.574917:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111504128:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789048836.574923:0:19099:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048836.574947:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111504128:12345-0@lo:38:kworker.0 Request processed in 30us (278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048836.574952:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789048836.574971:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789048836.574975:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111504384:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1789048836.574982:0:19099:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789048836.575005:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111504384:12345-0@lo:38:kworker.0 Request processed in 29us (305us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048836.575011:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789048836.575037:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111503872:0@lo:400:kworker.0 00000100:00080000:0.0:1789048836.575060:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048836.575064:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048836.575067:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111503616:0@lo:38:kworker.0 00000100:00080000:0.0:1789048836.575075:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048836.575078:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048836.575081:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111504128:0@lo:38:kworker.0 00000100:00080000:0.0:1789048836.575089:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048836.575092:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048836.575094:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111504384:0@lo:38:kworker.0 00000100:00100000:2.0:1789048836.575282:0:18912:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111503744:12345-0@lo:400:kworker.0 Request processed in 835us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048836.575289:0:18912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048836.575438:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111503744:0@lo:400:kworker.0 00000100:00100000:3.0:1789048836.589642:0:17122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111504000:12345-0@lo:38:kworker.0 Request processed in 14911us (15000us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048836.589656:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789048836.589940:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048836.589946:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048836.589950:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111504000:0@lo:38:kworker.0 00010000:00010000:3.0:1789048836.704538:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048837.728129:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:2.0:1789048838.622256:0:20694:0:(genops.c:1851:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:2.0:1789048838.639228:0:20694:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c3ea0e120 - data ffff959c3914a360/ffff959c3ef70000 00000020:01000000:3.0:1789048838.640850:0:20694:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c02989c60 - data ffff959b06146af8/ffff959c081a1800 00000001:00000004:3.0:1789048838.654681:0:20694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934640 00010000:00010000:0.0:1789048838.753458:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048838.766396:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048838.766409:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789048838.766437:0:20694:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff959b08842d80 x1875953111499136/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789048834 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048838.766498:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789048838.769686:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789048838.769697:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1789048838.769715:0:20694:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789048838.769719:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789048838.775305:0:17146:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789048838.775317:0:17146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789048838.775383:0:17146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1789048838.779199:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789048838.779212:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1789048838.779234:0:20694:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789048838.779238:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789048838.781053:0:17148:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789048838.781062:0:17148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1789048838.781074:0:17148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789048838.783258:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f1f 00000020:00000080:1.0:1789048838.783273:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3d2f6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789048838.783659:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789048838.793319:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f34 00000020:00000080:1.0:1789048838.793362:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3d2f3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789048838.793380:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789048838.793387:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048838.793397:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789048838.793399:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789048838.793406:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff959b077ecd40) has no exports 00000004:01000000:1.0:1789048838.793975:0:20694:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789048838.793988:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f96 00000020:00000080:1.0:1789048838.793994:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2aea2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789048838.794012:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789048838.794018:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048838.794025:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789048838.794027:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff959c3e8819c0) has no exports 00000020:00000080:1.0:1789048838.794036:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f8f 00000020:00000080:1.0:1789048838.794041:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2ac8e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789048838.794528:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2aea2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789048838.794554:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789048838.795754:0:20694:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789048838.795762:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789048838.795767:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789048838.795777:0:20694:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789048838.795779:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048838.795867:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048838.795880:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789048838.796051:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2ac8e800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789048838.796064:0:36:0:(genops.c:885:class_export_put()) final put ffff959c08afb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789048838.796068:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08afb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789048838.796077:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048838.796221:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f81 00000020:00000080:1.0:1789048838.796230:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c08afd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789048838.796275:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789048838.796281:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048838.796298:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789048838.796302:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff959c2022cd40) has no exports 00000020:00000080:1.0:1789048838.796310:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f7a 00000020:00000080:1.0:1789048838.796314:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2ac89000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789048838.798198:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08afd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1789048838.801552:0:20694:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789048838.801732:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789048838.801738:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789048838.801749:0:20694:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789048838.801753:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789048838.801818:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac89000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789048838.802008:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048838.802022:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789048838.802044:0:20694:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789048838.802054:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f6c 00000020:00000080:1.0:1789048838.802066:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2ac8a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789048838.802087:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2ac8c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789048838.802095:0:36:0:(genops.c:885:class_export_put()) final put ffff959c2ac8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789048838.802097:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789048838.802103:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789048838.802267:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789048838.802273:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048838.802279:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789048838.802285:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff959c3e880000) has no exports 00000020:00000080:1.0:1789048838.802293:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f65 00000020:00000080:1.0:1789048838.802298:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2eff8000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789048838.802321:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2ac8a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789048838.805241:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2eff8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789048838.805434:0:20694:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789048838.805441:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048838.805446:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789048838.805455:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789048838.805519:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048838.805521:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c03136800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789048838.805533:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048838.805542:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2effc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789048838.805546:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2effc000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789048838.805556:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048838.805711:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048838.805716:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048838.805720:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c416db800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789048838.805722:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c416db800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789048838.805728:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048838.805793:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f3b 00000020:00000080:0.0:1789048838.805801:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3d2f1000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789048838.805817:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789048838.805822:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048838.805828:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789048838.805851:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff959b077e8000) has no exports 00000020:00000080:3.0:1789048838.805859:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789048838.805877:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048838.805882:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789048838.805884:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3d2f2000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789048838.805887:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789048838.805906:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789048838.805938:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776f42 00000020:00000080:0.0:1789048838.805944:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3d2f4000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789048838.805976:0:20694:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c04ca4000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789048838.805981:0:20694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c04ca4000 3 00000020:01000004:0.0:1789048838.805984:0:20694:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c04ca4000 from lustre-MDT0000 00000020:00000080:0.0:1789048838.806008:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048838.806012:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789048838.806015:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3d2f0000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789048838.806017:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789048838.806026:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789048838.806055:0:20694:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789048838.806060:0:20694:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789048838.806063:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789048838.806066:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048838.806069:0:20694:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789048838.806076:0:20694:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff959b08010800 41c76bec-8493-4b0e-a7d0-3ca4d71b9234 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048838.806082:0:20694:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff959b079219c0) has exports, disconnecting them 00000020:00080000:0.0:1789048838.806087:0:20694:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff959b08010800), last request at 1789048722 00000020:00000080:0.0:1789048838.806113:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776ee7 00000020:00010000:0.0:1789048838.806118:0:20694:0:(genops.c:1920:obd_stale_export_put()) Put export ffff959b08010800: total 1 00000100:00080000:0.0:1789048838.806123:0:20694:0:(import.c:65:import_set_state_nolock()) ffff959b08017800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789048838.806140:0:20694:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b08010800): rc 0 00000020:00080000:0.0:1789048838.806145:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff959b079219c0) has no exports 00000020:00010000:0.0:1789048838.806202:0:17111:0:(genops.c:1906:obd_stale_export_get()) Get export ffff959b08010800: total 1 00010000:00010000:0.0:1789048838.806207:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048838.806241:0:17111:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff959b08010800, canceled 0 locks, left on hash table 13. 00000100:00100000:3.0:1789048838.806251:0:17117:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff959c3d30f000:17117] 2 exiting: rc = 0 00010000:00010000:0.0:1789048838.806290:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b08364400/0x133f221c08777172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c0877716b expref: 14 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806328:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef39800/0x133f221c0877749e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08777497 expref: 13 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806375:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3d400/0x133f221c087770c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087770bc expref: 12 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806392:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1a00/0x133f221c087774ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087774a5 expref: 11 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048838.806407:0:17116:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff959c3edc0c00:17116] 1 exiting: rc = 0 00010000:00010000:0.0:1789048838.806408:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb1800/0x133f221c08777022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c0877701b expref: 10 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806428:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061a00/0x133f221c087772d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c087772c9 expref: 9 pid: 17116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806439:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb1200/0x133f221c08776ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08776eee expref: 8 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806454:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061e00/0x133f221c0877730f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08777308 expref: 7 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789048838.806475:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3d2f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789048838.806478:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb0000/0x133f221c08777148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08777141 expref: 6 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806494:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07060000/0x133f221c087772a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c0877729f expref: 5 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806506:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb0a00/0x133f221c08777006 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08776fff expref: 4 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806519:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c04cb1a00/0x133f221c08777014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c0877700d expref: 3 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806545:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c400/0x133f221c08777490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x133f221c08777489 expref: 2 pid: 17117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048838.806557:0:17111:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff959b08010800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789048838.806577:0:17111:0:(genops.c:885:class_export_put()) final put ffff959b08010800/41c76bec-8493-4b0e-a7d0-3ca4d71b9234 00010000:00010000:0.0:1789048838.806605:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048838.806607:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048838.806608:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789048838.806634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08010800/41c76bec-8493-4b0e-a7d0-3ca4d71b9234 for MGS 00000020:00000080:3.0:1789048838.806670:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08017800 for MGS 00000100:00100000:3.0:1789048838.814462:0:17115:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff959c3edc0000:17115] 0 exiting: rc = 1 00000100:00100000:0.0:1789048838.814774:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.814787:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.814796:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.814806:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.814813:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.814820:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815024:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815033:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815040:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815048:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815054:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815062:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815068:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815074:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815082:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815089:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815094:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815100:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815107:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815113:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815118:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815124:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815129:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815134:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815159:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815165:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815179:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815186:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815194:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815200:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815206:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815211:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815219:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815226:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815236:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815242:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815248:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815262:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815268:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815274:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815279:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815284:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815290:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815308:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815314:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815321:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815328:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815358:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815365:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815371:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815377:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815383:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815390:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815396:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815403:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815408:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815414:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815421:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815427:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815441:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815446:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815453:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815460:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048838.815467:0:20694:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789048838.820754:0:20694:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b01cb0ba0 - data ffff959c3928e0d8/ffff959c2a4f3c00 00000020:01000000:0.0:1789048838.820971:0:20694:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b089d5f60 - data ffff959b06032360/ffff959c06e10c00 00000020:00000080:0.0:1789048838.821563:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776ecb 00000020:00000080:0.0:1789048838.821575:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3fcc5800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789048838.821605:0:20694:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c04ca4000 from MGS, refs=2 00000020:01000004:0.0:1789048838.821609:0:20694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c04ca4000 2 00000020:01000004:0.0:1789048838.821614:0:20694:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c04ca4000 from MGS 00000020:00000080:0.0:1789048838.821641:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048838.821650:0:20694:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789048838.821653:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3fcc4000/MGS 00000020:00000080:0.0:1789048838.821656:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fcc4000/MGS for MGS 00000020:01000000:0.0:1789048838.821663:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1789048838.821692:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fcc5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789048838.821747:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789048838.821753:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048838.821760:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789048838.821768:0:20694:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff959c2b605800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048838.821774:0:20694:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff959c3e883380) has exports, disconnecting them 00000020:00080000:0.0:1789048838.821779:0:20694:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff959c2b605800), last request at 1789048722 00000020:00000080:0.0:1789048838.821783:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776fce 00000020:00080000:0.0:1789048838.821793:0:20694:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c2b605800): rc 0 00000020:00000080:0.0:1789048838.821798:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2b605800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789048838.822065:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2b605800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789048838.855846:0:20694:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789048838.855860:0:20694:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048838.855867:0:20694:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789048838.855877:0:20694:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789048838.856022:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c2b600800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789048838.856493:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048838.856522:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789048838.856530:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c2aea7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789048838.856535:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2aea7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789048838.856543:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789048838.856651:0:20694:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c04ca4000 1 00000020:00000080:0.0:1789048838.864415:0:20694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776ebd 00000020:00000080:0.0:1789048838.864442:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c3fcc0800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789048838.864472:0:20694:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789048838.864482:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048838.864493:0:20694:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789048838.864499:0:20694:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff959c202299c0) has no exports 00000020:00000080:3.0:1789048838.864537:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fcc0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789048839.071997:0:20694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048839.072030:0:20694:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789048839.072038:0:20694:0:(genops.c:885:class_export_put()) final put ffff959c04ca1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789048839.072044:0:20694:0:(genops.c:844:class_export_destroy()) destroying export ffff959c04ca1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789048839.072060:0:20694:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789048839.072257:0:20694:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959c04ca3000 00000020:02000400:3.0:1789048839.072326:0:20694:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789048839.777129:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048840.157928:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789048840.157959:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111504640:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048840.158060:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048840.158142:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504640 00000100:00100000:2.0:1789048840.158153:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504640 00000100:00100000:2.0:1789048840.158228:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789048840.158240:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111504640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048840.158281:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048840.158359:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111504640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048840.158367:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789048840.158393:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048840.158440:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111504640:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789048840.803386:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048841.377767:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789048841.700290:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048841.700298:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789048841.700304:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048841.700315:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 591 00000100:00080000:1.0:1789048841.700322:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789048841.700352:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c414c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048841.700382:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c070a3800 x1875953111504896/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048841.700429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048841.700433:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789048841.700442:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048841.700446:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 591 00000100:00080000:1.0:1789048841.700451:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789048841.700458:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959b081c7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048841.700471:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c070a3480 x1875953111505280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048841.700481:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048841.700485:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789048841.700486:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048841.700490:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 591 00000100:00080000:1.0:1789048841.700493:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789048841.700497:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c08adc000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048841.700508:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c070a0700 x1875953111505408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048841.700525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048841.700528:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789048841.700530:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048841.700533:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 591 00000100:00080000:1.0:1789048841.700536:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789048841.700541:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b07620000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048841.700552:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c070a2a00 x1875953111505664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048841.700598:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111504768:0@lo:400:kworker.0 00000400:00000100:1.0:1789048841.700667:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111504768 offset 0 length 224: 4 00000100:00100000:3.0:1789048841.700952:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111505536:0@lo:400:kworker.0 00000100:00100000:3.0:1789048841.701007:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048841.701273:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111504896:0@lo:38:kworker.0 00000100:00100000:0.0:1789048841.701310:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048841.701354:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111505280:0@lo:38:kworker.0 00000100:00100000:0.0:1789048841.701377:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048841.701398:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111505408:0@lo:38:kworker.0 00000100:00100000:0.0:1789048841.701419:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048841.701439:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111505664:0@lo:38:kworker.0 00000100:00100000:0.0:1789048841.701463:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048841.701496:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505536 00000100:00100000:0.0:1789048841.701505:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505536 00000100:00100000:0.0:1789048841.701574:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505280 00000100:00100000:0.0:1789048841.701578:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505280 00000100:00100000:0.0:1789048841.701589:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505408 00000100:00100000:0.0:1789048841.701591:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505408 00000100:00100000:0.0:1789048841.701597:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505664 00000100:00100000:0.0:1789048841.701609:0:17124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505664 00000100:00100000:0.0:1789048841.701627:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789048841.701637:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111505536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048841.701942:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111505536:12345-0@lo:400:kworker.0 Request processed in 141us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048841.701951:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789048841.701975:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789048841.701979:0:17124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111505280:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789048841.702002:0:17124:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789048841.702349:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111505792:0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.702387:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048841.702430:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111505024:0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.702464:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048841.702489:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111505920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048841.702512:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048841.702537:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048841.702543:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c070a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111505152:0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.702565:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048841.702596:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111504896 00000100:00100000:1.0:1789048841.702603:0:18100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111504896 00000100:00100000:1.0:1789048841.702632:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789048841.702637:0:18100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3619:x1875953111504896:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789048841.702651:0:18100:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1789048841.705761:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048841.707949:0:18100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3619:x1875953111504896:12345-0@lo:38:kworker.0 Request processed in 5298us (6626us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048841.707968:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789048841.708048:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505024 00000100:00100000:1.0:1789048841.708060:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505024 00000100:00100000:1.0:1789048841.708108:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505152 00000100:00100000:1.0:1789048841.708111:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505152 00000100:00100000:1.0:1789048841.708142:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789048841.708151:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111505024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.708235:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111505024:12345-0@lo:400:kworker.0 Request processed in 85us (5771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048841.708242:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789048841.708264:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048841.708270:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111505152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.708298:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111505152:12345-0@lo:400:kworker.0 Request processed in 29us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048841.708304:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048841.708323:0:18633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505920 00000100:00100000:1.0:1789048841.708327:0:18633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505920 00000100:00100000:1.0:1789048841.708369:0:18633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789048841.708376:0:18633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111505920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048841.708401:0:18633:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048841.708433:0:18633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111505920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (5919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048841.708439:0:18633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789048841.708492:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048841.708499:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048841.708504:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111504896:0@lo:38:kworker.0 00000100:00080000:1.0:1789048841.708540:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789048841.708575:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111505152:0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.708587:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111505024:0@lo:400:kworker.0 00000100:00100000:1.0:1789048841.708603:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111505920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048841.709352:0:19099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111505792 00000100:00100000:3.0:1789048841.709360:0:19099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111505792 00000100:00100000:3.0:1789048841.709412:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789048841.709421:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c070a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111505792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048841.709490:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c070a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111505792:12345-0@lo:400:kworker.0 Request processed in 71us (7102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048841.709496:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789048841.709513:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048841.709517:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111505408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789048841.709538:0:19099:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789048841.709643:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111505408:12345-0@lo:38:kworker.0 Request processed in 123us (8222us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048841.709650:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789048841.709667:0:19099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789048841.709672:0:19099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111505664:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789048841.709683:0:19099:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789048841.709713:0:19099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1875953111505664:12345-0@lo:38:kworker.0 Request processed in 40us (8249us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048841.709729:0:19099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1789048841.711114:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff959c070a2680 x1875953111505536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048841.711136:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111505536:0@lo:400:kworker.0 00000100:00080000:3.0:1789048841.711170:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048841.711199:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048841.711205:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048841.711208:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111505408:0@lo:38:kworker.0 00000100:00080000:3.0:1789048841.711222:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048841.711226:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048841.711229:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111505664:0@lo:38:kworker.0 00010000:00080000:3.0:1789048841.717198:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff959c070a1f80 x1875953111505792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048841.717224:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111505792:0@lo:400:kworker.0 00000100:00100000:0.0:1789048841.741507:0:17124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111505280:12345-0@lo:38:kworker.0 Request processed in 39508us (40111us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048841.741527:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789048841.742180:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048841.742188:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048841.742193:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111505280:0@lo:38:kworker.0 00010000:00010000:0.0:1789048841.821537:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048842.845564:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789048843.312988:0:20897:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789048843.338851:0:20897:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789048843.338908:0:20897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.338923:0:20897:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.338930:0:20897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.338936:0:20897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.338999:0:20897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789048843.339005:0:20897:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789048843.339032:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048843.339048:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789048843.339062:0:20897:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789048843.339069:0:20897:0:(import.c:65:import_set_state_nolock()) ffff959b081c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789048843.339074:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048843.339076:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789048843.339079:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789048843.340683:0:20897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.340702:0:20897:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.340727:0:20897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.340734:0:20897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.340926:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048843.340935:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.340943:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048843.340947:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.340956:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048843.340963:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048843.340969:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048843.340979:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789048843.340982:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789048843.341024:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341030:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789048843.341293:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111506048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048843.341378:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048843.341463:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341471:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba0c00/0x133f221c087770bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c087770c3 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341485:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048843.341489:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341494:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048843.341497:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341503:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048843.341510:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048843.341515:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048843.341517:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789048843.341531:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341536:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048843.341558:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048843.341566:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048843.341567:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048843.341569:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048843.341592:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111506176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048843.341695:0:17109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111506048 00000100:00100000:1.0:1789048843.341703:0:17109:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111506048 00000100:00100000:1.0:1789048843.341740:0:17109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048843.341747:0:17109:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3623:x1875953111506048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789048843.341753:0:17109:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789048843 with bad export cookie 1386864714049875687 00000100:00100000:0.0:1789048843.342574:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048843.342659:0:17108:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789048843.342669:0:17108:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789048843.342707:0:17107:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789048843.342714:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111506176 00000100:00100000:0.0:1789048843.342719:0:17107:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111506176 00000100:00100000:0.0:1789048843.342983:0:20898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048843.342991:0:20898:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1875953111506176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789048843.342997:0:20898:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789048843 with bad export cookie 1386864714049875687 00000100:00100000:0.0:1789048843.343047:0:20898:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3620:x1875953111506176:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (476us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789048843.343068:0:20898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789048843.343104:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789048843.343109:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789048843.343113:0:3620:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789048843.343653:0:20897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789048843.343663:0:20897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08364600/0x133f221c0877701b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c08777022 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.343942:0:20897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.343952:0:20897:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.343971:0:20897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.343977:0:20897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.343992:0:20897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048843.343999:0:20897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344005:0:20897:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344011:0:20897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344017:0:20897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344024:0:20897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789048843.344029:0:20897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344046:0:20897:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344051:0:20897:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344365:0:20897:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048843.344373:0:20897:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789048843.344378:0:20897:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789048843.344383:0:20897:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789048843.344418:0:20897:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789048843.344422:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789048843.344426:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048843.344431:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789048843.344437:0:20897:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff959c08ade800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789048843.344442:0:20897:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff959b08a4f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789048843.344447:0:20897:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff959c3ef7cd40) has exports, disconnecting them 00000020:00080000:3.0:1789048843.344451:0:20897:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff959c08ade800), last request at 1789048841 00000020:00000080:3.0:1789048843.344458:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087772fa 00000100:00080000:3.0:1789048843.344474:0:20897:0:(import.c:65:import_set_state_nolock()) ffff959c08ad9000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789048843.344514:0:20897:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c08ade800): rc 0 00000020:00000080:3.0:1789048843.344516:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c08ade800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789048843.344532:0:20897:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff959b08a4f800), last request at 1789048841 00000020:00000080:3.0:1789048843.344536:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877719c 00000100:00080000:3.0:1789048843.344540:0:20897:0:(import.c:65:import_set_state_nolock()) ffff959b08a4e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789048843.344546:0:20897:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b08a4f800): rc 0 00000020:00000080:3.0:1789048843.344548:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b08a4f800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789048843.344554:0:20897:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb770c1d17ae0 00000100:00080000:3.0:1789048843.344571:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789048843.344580:0:20897:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff959c3958d180 x1875953111500160/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789048841 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048843.344679:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:2.0:1789048843.345243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08ade800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789048843.345294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08a4f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789048843.345320:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c08ad9000 for lustre-MDT0001 00000020:00000080:2.0:1789048843.345325:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08a4e800 for lustre-MDT0001 00000100:00080000:3.0:1789048843.345930:0:20897:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789048843.345938:0:20897:0:(import.c:65:import_set_state_nolock()) ffff959c414c7800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789048843.346187:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789048843.346192:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789048843.346210:0:20897:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789048843.346268:0:20897:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789048843.346294:0:20897:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789048843.346312:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789048843.346315:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789048843.346325:0:20897:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789048843.346423:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111506304:0@lo:9:umount.0 00000100:00100000:3.0:1789048843.346493:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789048843.346538:0:20897:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789048843.346548:0:20897:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789048843.346563:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111506432:0@lo:9:umount.0 00000100:00100000:3.0:1789048843.346585:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789048843.346652:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff959c3ef7cd40) has no exports 00000100:00100000:1.0:1789048843.353693:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111506304 00000100:00100000:1.0:1789048843.353706:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111506304 00000100:00100000:1.0:1789048843.353951:0:18631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111506432 00000100:00100000:1.0:1789048843.353955:0:18631:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111506432 00000100:00100000:1.0:1789048843.353988:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048843.353999:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875953111506304:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789048843.354034:0:18631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087771c6 00000100:00080000:1.0:1789048843.354045:0:18631:0:(import.c:65:import_set_state_nolock()) ffff959b08a4d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789048843.354093:0:18631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1789048843.354506:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3619:x1875953111506304:12345-0@lo:9:umount.0 Request processed in 507us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048843.354515:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048843.354761:0:18631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789048843.354769:0:18631:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875953111506432:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789048843.354784:0:18631:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877732b 00000100:00080000:1.0:1789048843.354802:0:18631:0:(import.c:65:import_set_state_nolock()) ffff959b076eb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789048843.354825:0:18631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1789048843.354967:0:18631:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3619:x1875953111506432:12345-0@lo:9:umount.0 Request processed in 198us (8379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048843.354973:0:18631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789048843.355172:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789048843.355182:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789048843.355186:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789048843.355192:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111506432:0@lo:9:umount.0 00000100:00080000:1.0:1789048843.355225:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c414c0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789048843.355241:0:3619:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789048843.355244:0:3619:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789048843.355246:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111506304:0@lo:9:umount.0 00000100:00080000:3.0:1789048843.355429:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789048843.355436:0:17118:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048843.355762:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111500160:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789048843.355807:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789048843.355815:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.355826:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048843.355831:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.355894:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048843.355902:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048843.355922:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789048843.355925:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789048843.355928:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789048843.358293:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789048843.369226:0:17109:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3623:x1875953111506048:12345-0@lo:103:ldlm_bl.0 Request processed in 27462us (27831us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789048843.369245:0:17109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789048843.370412:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789048843.376378:0:3620:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.116@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789048843.376385:0:3620:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789048843.376396:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c070a0000 x1875953111504768/t0(0) o400->MGC192.168.202.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789048857 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048843.376425:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d75f80 x1875953111506048/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789048859 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048843.376437:0:3620:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d74e00 x1875953111506176/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789048859 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789048843.376465:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789048843.376468:0:3620:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789048843.376470:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789048843.377430:0:3623:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff959c04ca3800 already not connected (conn 1, was 1): DISCONN 00010000:00010000:2.0:1789048843.377438:0:17110:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.377453:0:17110:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789048843.377471:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.377482:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x133f221c0877730f expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.378199:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048843.378207:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.378215:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048843.378219:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.378229:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048843.378237:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048843.378242:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789048843.378246:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789048843.378260:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789048843.378274:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:2.0:1789048843.378278:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.378285:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08364200/0x133f221c0877700d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777014 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.378297:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048843.378299:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048843.378301:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048843.378693:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3623:1875953111506048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048843.380005:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048843.380012:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048843.380015:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048843.380958:0:3620:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048843.380974:0:3620:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1789048843.380991:0:3620:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959c04ca3800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048843.381047:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:0:1875953111506560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048843.381081:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c070a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3621:1875953111504768:0@lo:400:kworker.0 00010000:00010000:2.0:1789048843.381097:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.381110:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:2.0:1789048843.381115:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.381135:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789048843.381142:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048843.381147:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789048843.381150:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789048843.381154:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789048843.381169:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:2.0:1789048843.381173:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.381200:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c087774a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087774ac expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048843.381216:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048843.381218:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048843.381221:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048843.384529:0:3620:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d75880 x1875953111506688/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048843.384574:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3620:1875953111506176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048843.388276:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111506688:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789048843.388414:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111506688 offset 0 length 520: 4 00000020:00080000:2.0:1789048843.390706:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff959c3ef7cd40) has no exports 00000020:01000000:0.0:1789048843.494170:0:20897:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c3ea0e1e0 - data ffff959c08443bd0/ffff959c3ef73c00 00000020:01000000:0.0:1789048843.494376:0:20897:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959c04925600 - data ffff959c3906b6c0/ffff959c07064c00 00000001:00000004:0.0:1789048843.516491:0:20897:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789048843.572659:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789048843.572672:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789048843.572683:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789048843.577809:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789048843.577816:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789048843.577833:0:20897:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048843.577836:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789048843.578772:0:17864:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789048843.578778:0:17864:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1789048843.578800:0:17864:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789048843.579896:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789048843.579901:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789048843.579915:0:20897:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048843.579917:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789048843.581678:0:17866:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789048843.581686:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789048843.581697:0:17866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789048843.583782:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777030 00000020:00000080:2.0:1789048843.583807:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c3fb97800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789048843.585038:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb97800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789048843.589928:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777045 00000020:00000080:2.0:1789048843.589943:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c08ada800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789048843.589966:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789048843.589975:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048843.589984:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789048843.589988:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff959c3ef799c0) has no exports 00000020:00000080:3.0:1789048843.590486:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08ada800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1789048843.591302:0:20897:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789048843.591314:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777099 00000020:00000080:2.0:1789048843.591321:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b0683a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789048843.591366:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789048843.591383:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048843.591390:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789048843.591394:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff959c394bb380) has no exports 00000020:00000080:2.0:1789048843.591401:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777092 00000020:00000080:2.0:1789048843.591406:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b08339000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789048843.591831:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0683a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789048843.591919:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08339000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789048843.592675:0:20897:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789048843.592681:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789048843.592685:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789048843.592692:0:20897:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048843.592694:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048843.592735:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048843.592744:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789048843.592751:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777084 00000020:00000080:2.0:1789048843.592757:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c2088e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789048843.592762:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789048843.592767:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048843.592771:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789048843.592774:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff959b07924d40) has no exports 00000020:00000080:2.0:1789048843.592779:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777076 00000020:00000080:2.0:1789048843.592783:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c414c3800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789048843.593117:0:20897:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789048843.593255:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789048843.593258:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789048843.593262:0:20897:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789048843.593264:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789048843.593290:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789048843.593295:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789048843.593309:0:20897:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789048843.593316:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777068 00000020:00000080:2.0:1789048843.593321:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b06838800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789048843.593326:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789048843.593330:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789048843.593386:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789048843.593388:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff959b07923380) has no exports 00000020:00000080:2.0:1789048843.593394:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777061 00000020:00000080:2.0:1789048843.593398:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c414c7000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789048843.594309:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b0833b800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789048843.594321:0:36:0:(genops.c:885:class_export_put()) final put ffff959c20889000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789048843.594325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c20889000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789048843.594358:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048843.594445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2088e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789048843.594451:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c414c3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789048843.594457:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c414c0800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789048843.594461:0:36:0:(genops.c:885:class_export_put()) final put ffff959b0683b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789048843.594463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b0683b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789048843.594466:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048843.594501:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06838800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789048843.594507:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c414c7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789048843.601716:0:20897:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789048843.601724:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789048843.601728:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789048843.601736:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789048843.601803:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048843.601815:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048843.601854:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048843.601871:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048843.601878:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b05da5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789048843.601882:0:20897:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05da5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789048843.601888:0:20897:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789048843.602033:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c0877704c 00000020:00000080:3.0:1789048843.602039:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c08ad8000/lustre-MDD0001_UUID 00000020:01000000:3.0:1789048843.602044:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789048843.602048:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048843.602063:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789048843.602068:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff959c3ef78000) has no exports 00000020:00000080:3.0:1789048843.602086:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048843.602089:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789048843.602093:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777053 00000020:00000080:3.0:1789048843.602097:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c08add000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789048843.602104:0:20897:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c08aff800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789048843.602107:0:20897:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c08aff800 2 00000020:01000004:3.0:1789048843.602111:0:20897:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c08aff800 from lustre-MDT0001 00000020:00000080:3.0:1789048843.602257:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048843.602262:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789048843.602265:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c3fb92000/lustre-MDT0001_UUID 00000020:00000080:3.0:1789048843.602267:0:20897:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb92000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789048843.602275:0:20897:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789048843.602306:0:20897:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789048843.602310:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789048843.602313:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048843.602316:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789048843.602322:0:20897:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff959c2eff9000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789048843.602328:0:20897:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff959c394b8000) has exports, disconnecting them 00000020:00080000:3.0:1789048843.602359:0:20897:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff959c2eff9000), last request at 1789048738 00000020:00000080:3.0:1789048843.602363:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087770d1 00000020:00080000:3.0:1789048843.602373:0:20897:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c2eff9000): rc 0 00000020:00000080:3.0:1789048843.602383:0:20897:0:(genops.c:885:class_export_put()) final put ffff959c2eff9000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789048843.603575:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c414c7800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789048843.603589:0:36:0:(genops.c:885:class_export_put()) final put ffff959c33593800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789048843.603592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c33593800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789048843.603604:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789048843.603707:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08ad8000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789048843.603712:0:36:0:(genops.c:885:class_export_put()) final put ffff959c3fb93000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789048843.603714:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb93000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789048843.603717:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789048843.603838:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08add000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789048843.603844:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2eff9000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789048843.688467:0:20897:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789048843.688476:0:20897:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789048843.688480:0:20897:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789048843.688488:0:20897:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048843.688532:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b081c7800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789048843.688748:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048843.688766:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789048843.688772:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b08339800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789048843.688776:0:20897:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08339800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789048843.688787:0:20897:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789048843.688864:0:20897:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c08aff800 1 00000020:00000080:1.0:1789048843.688870:0:20897:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776ff8 00000020:00000080:1.0:1789048843.688876:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b05da7800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789048843.688884:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789048843.688892:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05da7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789048843.688901:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048843.688906:0:20897:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789048843.688909:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff959c3e884d40) has no exports 00010000:00010000:2.0:1789048843.870852:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789048843.907059:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048843.907073:0:20897:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789048843.907080:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b05da3000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789048843.907085:0:20897:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05da3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789048843.907095:0:20897:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789048843.907213:0:20897:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959c2b604000 00000020:01000000:0.0:1789048843.907232:0:20897:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789048843.907236:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048843.907240:0:20897:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789048843.907245:0:20897:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff959b077eb380) has no exports 00000100:00100000:3.0:1789048843.908742:0:19099:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff959b08210600:19099] 3 exiting: rc = 0 00000100:00100000:0.0:1789048843.909062:0:17124:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff959c3ebe7400:17124] 2 exiting: rc = 0 00000100:00100000:0.0:1789048843.909169:0:20608:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff959b01a61a00:20608] 4 exiting: rc = 0 00000100:00100000:0.0:1789048843.909263:0:17123:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff959c3ebe6e00:17123] 1 exiting: rc = 0 00000100:00100000:2.0:1789048843.912982:0:17122:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff959b05d8c600:17122] 0 exiting: rc = 1 00000100:00100000:3.0:1789048843.913186:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913197:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913202:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913208:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913216:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913221:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913227:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913232:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913238:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913244:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913250:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913256:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913263:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913269:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913274:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913280:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913286:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913292:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913298:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913303:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913309:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913314:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913319:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913324:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913329:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913365:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913372:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913378:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913383:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913389:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913395:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913401:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913407:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913429:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913434:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913439:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913444:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913449:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913455:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913460:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913465:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913470:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913476:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913482:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913488:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913494:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913499:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913505:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913511:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913517:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913522:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913527:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913533:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913540:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913546:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913552:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913558:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913563:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913569:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913575:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913581:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913586:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913591:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.913596:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.916122:0:17125:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff959c3ebe6800:17125] 0 exiting: rc = 1 00000100:00100000:2.0:1789048843.916421:0:17126:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff959c3ebe6400:17126] 1 exiting: rc = 0 00000100:00100000:3.0:1789048843.916749:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916758:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916765:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916773:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916801:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916807:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916812:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916817:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916823:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916829:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916834:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916840:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916846:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916851:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916857:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916862:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916868:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916874:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916879:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916884:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916891:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916896:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916902:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916907:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916912:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916917:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916922:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916927:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916933:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916938:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916943:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916947:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916952:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916958:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916963:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916968:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916973:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916979:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916985:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.916999:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917004:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917008:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917013:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917019:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917024:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917029:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917034:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917039:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917045:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917051:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917056:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917061:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917066:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917071:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917076:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917081:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917085:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917090:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917095:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917100:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917105:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917110:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917115:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917121:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048843.917619:0:18100:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff959c2a74da00:18100] 2 exiting: rc = 0 00000100:00100000:2.0:1789048843.917717:0:17128:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff959c395a4e00:17128] 1 exiting: rc = 0 00000100:00100000:0.0:1789048843.917866:0:17127:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff959c395a5000:17127] 0 exiting: rc = 1 00000100:00100000:3.0:1789048843.917963:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917971:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917976:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917983:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.917996:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918005:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918011:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918018:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918024:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918030:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918046:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918052:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918060:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918065:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918071:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918078:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918097:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918105:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918111:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918118:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918124:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918130:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918135:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918142:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918149:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918155:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918162:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918168:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918187:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918194:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918200:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918206:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918212:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918217:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918223:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918229:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918236:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918242:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918247:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918254:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918272:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918279:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918286:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918293:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918299:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918311:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918318:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918325:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918369:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918376:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918382:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918388:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918409:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918416:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918422:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918429:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918435:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918442:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918448:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918454:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918462:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918468:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918474:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.918481:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.934880:0:17130:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff959c395a4000:17130] 1 exiting: rc = 0 00000100:00100000:1.0:1789048843.935125:0:17129:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff959c395a4800:17129] 0 exiting: rc = 1 00000100:00100000:3.0:1789048843.937175:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937185:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937191:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937201:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937208:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937214:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937219:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937224:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937229:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937234:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937239:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937243:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937249:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937254:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937258:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937282:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937288:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937293:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937298:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937303:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937307:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937312:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937316:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937320:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937325:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937329:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937352:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937357:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937363:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937367:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937372:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937377:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937382:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937386:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937390:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937396:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937401:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937405:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937410:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937414:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937419:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937424:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937429:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937434:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937439:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937443:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937448:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937452:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937458:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937463:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937476:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937481:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937485:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937491:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937496:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937500:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937505:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937511:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937516:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937522:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937527:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937532:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937536:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.937542:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048843.938806:0:17131:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff959c395a4400:17131] 0 exiting: rc = 1 00000100:00100000:3.0:1789048843.939027:0:17132:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff959c395a4a00:17132] 1 exiting: rc = 0 00000100:00100000:0.0:1789048843.939126:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939143:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939149:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939154:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939159:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939164:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939169:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939174:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939180:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939186:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939192:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939197:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939202:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939207:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939212:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939218:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939224:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939229:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939234:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939239:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939244:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939248:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939253:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939258:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939263:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939268:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939272:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939277:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939282:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939287:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939292:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939297:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939301:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939306:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939311:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939315:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939327:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939447:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939454:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939459:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939464:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939469:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939474:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939479:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939483:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939488:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939493:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939497:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939503:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939508:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939512:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939517:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939522:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939526:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939531:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939536:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939541:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939546:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939550:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939555:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939559:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939565:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939570:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789048843.939574:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940226:0:17134:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff959b07ae7e00:17134] 1 exiting: rc = 0 00000100:00100000:2.0:1789048843.940395:0:17133:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff959b07ae6400:17133] 0 exiting: rc = 1 00000100:00100000:1.0:1789048843.940519:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940525:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940531:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940536:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940541:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940546:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940551:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940556:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940561:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940566:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940570:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940575:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940580:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940585:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940590:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940595:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940600:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940605:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940610:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940625:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940630:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940634:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940640:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940645:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940650:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940654:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940659:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940665:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940670:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940675:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940680:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940685:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940690:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940694:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940699:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940704:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940708:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940713:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940719:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940724:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940729:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940733:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940738:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940744:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940749:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940754:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940759:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940764:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940770:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940775:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940780:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940785:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940803:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940808:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940820:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940826:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940831:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940837:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940842:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940847:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940852:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940857:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940862:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.940866:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048843.941646:0:17135:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff959c395a5400:17135] 0 exiting: rc = 1 00000100:00100000:3.0:1789048843.941951:0:17136:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff959c395a5a00:17136] 1 exiting: rc = 0 00000100:00100000:3.0:1789048843.942106:0:17137:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff959c395a5c00:17137] 2 exiting: rc = 0 00000100:00100000:1.0:1789048843.942292:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942300:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942306:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942312:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942318:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942324:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942389:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942397:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942416:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942424:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942430:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942435:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942441:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942447:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942453:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942460:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942467:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942473:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942481:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942486:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942493:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942499:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942505:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942511:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942517:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942534:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942541:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942547:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942554:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942560:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942567:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942573:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942593:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942599:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942615:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942621:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942626:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942631:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942637:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942642:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942649:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942655:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942661:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942667:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942672:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942678:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942683:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942690:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942697:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942704:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942709:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942715:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942720:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942727:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942732:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942738:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942759:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942767:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942772:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942777:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942799:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942806:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942811:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048843.942816:0:20897:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789048843.946719:0:20897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048843.946732:0:20897:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789048843.946738:0:20897:0:(genops.c:885:class_export_put()) final put ffff959b08803000/MDS_uuid 00000020:00000080:1.0:1789048843.946743:0:20897:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08803000/MDS_uuid for MDS 00000020:01000000:1.0:1789048843.946749:0:20897:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789048843.946890:0:20897:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1789048844.898204:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048845.918621:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048846.816032:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048846.816042:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048846.816045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048846.816049:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048846.816053:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048846.816071:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 596 00000100:00080000:0.0:1789048846.816076:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789048846.816095:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c08adc000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048846.816133:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d74e00 x1875953111506816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048846.816193:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111506816:0@lo:38:kworker.0 00000400:00000100:1.0:1789048846.816245:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111506816 offset 0 length 520: 4 00000100:00080000:0.0:1789048846.816330:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048846.816350:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048846.816353:0:37:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048846.816357:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 596 00000100:00080000:0.0:1789048846.816360:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789048846.816364:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959b07620000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048846.816377:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d74a80 x1875953111507072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048846.816437:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111506944:0@lo:400:kworker.0 00000400:00000100:2.0:1789048846.816462:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111506944 offset 0 length 224: 4 00000100:00100000:1.0:1789048846.829003:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111507072:0@lo:38:kworker.0 00000400:00000100:1.0:1789048846.829064:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507072 offset 0 length 520: 4 00000100:00100000:2.0:1789048846.833242:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111507200:0@lo:400:kworker.0 00000400:00000100:2.0:1789048846.833309:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507200 offset 0 length 224: 4 00010000:00010000:2.0:1789048846.944546:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048847.942150:0:21100:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:0.0:1789048847.970120:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048847.970725:0:21100:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789048847.970788:0:21100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048847.970802:0:21100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048847.970810:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048847.970817:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048847.970850:0:21100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048847.970856:0:21100:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789048847.970886:0:21100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048847.970899:0:21100:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d74e00 x1875953111506816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048847.970913:0:21100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789048847.970920:0:21100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789048847.970926:0:21100:0:(import.c:65:import_set_state_nolock()) ffff959c08adc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789048847.970930:0:21100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048847.970934:0:21100:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d74e00 x1875953111506816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048871 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048847.970941:0:21100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789048847.970944:0:21100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 32s for inflight to error out 00010000:00010000:1.0:1789048847.971721:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048847.971729:0:17111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048847.971739:0:17111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3dc00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048847.971743:0:17111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048847.971783:0:17111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048847.971790:0:17111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048847.971796:0:17111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789048847.971799:0:17111:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789048847.971808:0:17111:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789048847.971822:0:17111:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:1.0:1789048847.971826:0:17111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048847.971833:0:17111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3dc00/0x133f221c0877716b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777172 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048847.971844:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048847.971846:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048847.971848:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048847.971878:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111506816:0@lo:38:kworker.0 00000100:00080000:0.0:1789048847.972910:0:21100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048847.972924:0:21100:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d77800 x1875953111506944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048862 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048847.973556:0:21100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1789048847.973668:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111506944:0@lo:400:kworker.0 00000100:00080000:1.0:1789048847.976663:0:21100:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789048847.976699:0:21100:0:(import.c:65:import_set_state_nolock()) ffff959b08a4c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789048847.976893:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111507328:0@lo:39:umount.0 00000400:00000100:2.0:1789048847.976959:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507328 offset 0 length 224: 4 00000100:00080000:3.0:1789048848.861583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048848.861594:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048848.861598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048848.861602:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048848.861931:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111507456:0@lo:400:kworker.0 00000400:00000100:0.0:1789048848.861987:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507456 offset 0 length 224: 4 00010000:00010000:2.0:1789048848.993391:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789048849.377400:0:18626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789048849.377411:0:18626:0:(genops.c:885:class_export_put()) final put ffff959b08a4f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789048849.377497:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08a4f000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789048849.377563:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08a4d800 for lustre-OST0000 00000001:00100000:0.0:1789048849.377685:0:19445:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789048849.377689:0:19445:0:(genops.c:885:class_export_put()) final put ffff959c05306000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789048849.377757:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c05306000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789048849.377801:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b076eb000 for lustre-OST0001 00010000:00010000:0.0:1789048850.014370:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048851.037736:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048851.871560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048851.871572:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048851.871576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048851.871598:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048851.871735:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111507584:0@lo:400:kworker.0 00000400:00000100:2.0:1789048851.871810:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507584 offset 0 length 224: 4 00010000:00010000:2.0:1789048852.064651:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048853.087384:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048843/real 1789048843] req@ffff959b05d75880 x1875953111506688/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789048853 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048853.087420:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b05d75880 x1875953111506688/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789048853 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789048853.087453:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048853.087478:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789048853.087483:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111506688:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789048853.087638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048853.087655:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789048853.087658:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048853.087663:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 598 00000100:00080000:3.0:1789048853.087686:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789048853.087696:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959c04ca3800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048853.087765:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c03e54380 x1875953111507712/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1789048853.087765:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048853.087792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048853.087796:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048853.087948:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111507840:0@lo:400:kworker.0 00000400:00000100:2.0:1789048853.087999:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507840 offset 0 length 224: 4 00000100:00100000:1.0:1789048853.088407:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111507712:0@lo:250:kworker.0 00000400:00000100:1.0:1789048853.088445:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111507712 offset 0 length 520: 4 00010000:00010000:1.0:1789048854.109795:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048855.133939:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048856.162484:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048857.181575:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048847/real 1789048847] req@ffff959c3fcd3480 x1875953111507328/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048857 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048857.181628:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c3fcd3480 x1875953111507328/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048857 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048857.181818:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b08a4c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789048857.181835:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111507328:0@lo:39:umount.0 00010000:00010000:2.0:1789048857.182511:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789048857.182518:0:21100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789048857.182580:0:21100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789048857.182587:0:21100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789048857.185839:0:21100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186180:0:21100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186188:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186195:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186222:0:21100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048857.186230:0:21100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186236:0:21100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186242:0:21100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186248:0:21100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048857.186272:0:21100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048857.186408:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048857.186415:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186421:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048857.186424:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186430:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048857.186435:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048857.186439:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048857.186441:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789048857.186450:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:0.0:1789048857.186453:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186457:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08365e00/0x133f221c08777141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777148 expref: -99 pid: 18625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186470:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048857.186472:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186488:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048857.186491:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186495:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048857.186499:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048857.186502:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789048857.186504:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789048857.186506:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:0.0:1789048857.186508:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048857.186517:0:21100:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789048857.186517:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef39e00/0x133f221c08777497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c0877749e expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048857.186526:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048857.186527:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048857.186529:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048857.186745:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048857.186766:0:21100:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789048857.186832:0:21100:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789048857.186934:0:21100:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789048857.186939:0:21100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789048857.186945:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048857.186952:0:21100:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789048857.186956:0:21100:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff959c2022b380) has no exports 00000020:00080000:1.0:1789048857.186982:0:21100:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff959c2022b380) has no exports 00000020:01000000:1.0:1789048857.194981:0:21100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b076d70c0 - data ffff959b0608bca8/ffff959b08ca6400 00000020:01000000:1.0:1789048857.195245:0:21100:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b06b16660 - data ffff959c112bcaf8/ffff959b08a0ac00 00100000:10000000:1.0:1789048857.207283:0:21100:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789048857.216313:0:21100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777156 00000020:00000080:3.0:1789048857.216325:0:21100:0:(genops.c:885:class_export_put()) final put ffff959b05d94000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789048857.216357:0:21100:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959b081c1800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789048857.216361:0:21100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b081c1800 2 00000020:01000004:3.0:1789048857.216365:0:21100:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959b081c1800 from lustre-OST0000 00000020:00000080:3.0:1789048857.216386:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048857.216395:0:21100:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789048857.216398:0:21100:0:(genops.c:885:class_export_put()) final put ffff959b05d93800/lustre-OST0000_UUID 00000020:00000080:3.0:1789048857.216400:0:21100:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05d93800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789048857.216406:0:21100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789048857.216453:0:21100:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789048857.216457:0:21100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789048857.216461:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048857.216467:0:21100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789048857.216474:0:21100:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff959c3fb97000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789048857.216480:0:21100:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff959c3ef7b380) has exports, disconnecting them 00000020:00080000:3.0:1789048857.216484:0:21100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff959c3fb97000), last request at 1789048757 00000020:00000080:3.0:1789048857.216488:0:21100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777180 00000020:00080000:3.0:1789048857.216497:0:21100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c3fb97000): rc 0 00000020:00000080:3.0:1789048857.216502:0:21100:0:(genops.c:885:class_export_put()) final put ffff959c3fb97000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789048857.216745:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b05d94000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789048857.216758:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb97000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789048857.221473:0:21100:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789048857.221482:0:21100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789048857.221487:0:21100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789048857.221494:0:21100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048857.221714:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048857.221724:0:21100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789048857.221731:0:21100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789048857.221737:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048857.221741:0:21100:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789048857.221747:0:21100:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff959b08a4a000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789048857.221754:0:21100:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff959b088b19c0) has exports, disconnecting them 00000020:00080000:1.0:1789048857.221757:0:21100:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff959b08a4a000), last request at 1789048757 00000020:00000080:1.0:1789048857.221762:0:21100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777195 00000020:00080000:1.0:1789048857.221776:0:21100:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b08a4a000): rc 0 00000020:00000080:1.0:1789048857.221780:0:21100:0:(genops.c:885:class_export_put()) final put ffff959b08a4a000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789048857.222468:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c08adc000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789048857.222477:0:36:0:(genops.c:885:class_export_put()) final put ffff959c3fb93800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789048857.222480:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb93800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789048857.222490:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789048857.222547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08a4a000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789048857.225525:0:21100:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789048857.225549:0:21100:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048857.225553:0:21100:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789048857.225560:0:21100:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789048857.225589:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b08a4c800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789048857.225819:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048857.225827:0:21100:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789048857.225832:0:21100:0:(genops.c:885:class_export_put()) final put ffff959b08a48800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789048857.225835:0:21100:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08a48800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789048857.225841:0:21100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789048857.225905:0:21100:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959b081c1800 1 00000020:00000080:0.0:1789048857.225911:0:21100:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777133 00000020:00000080:0.0:1789048857.225917:0:21100:0:(genops.c:885:class_export_put()) final put ffff959b06950800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789048857.225926:0:21100:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789048857.225934:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06950800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789048857.225944:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048857.225950:0:21100:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789048857.225953:0:21100:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff959c2a423380) has no exports 00000020:00000080:0.0:1789048857.297453:0:21100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048857.297470:0:21100:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789048857.297477:0:21100:0:(genops.c:885:class_export_put()) final put ffff959b081c3800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789048857.297482:0:21100:0:(genops.c:844:class_export_destroy()) destroying export ffff959b081c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789048857.297493:0:21100:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789048857.298459:0:21100:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959b081c5800 00000020:02000400:0.0:1789048857.298511:0:21100:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789048858.205904:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789048858.590437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048858.590448:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048858.590457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789048858.590460:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048858.590570:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111507968:0@lo:400:kworker.0 00000400:00000100:2.0:1789048858.590621:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111507968 offset 0 length 224: 4 00010000:00010000:1.0:1789048859.234318:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048860.253674:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048861.279160:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789048861.694005:0:21316:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789048861.718572:0:21316:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789048861.718664:0:21316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048861.718681:0:21316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048861.718702:0:21316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048861.718709:0:21316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048861.718732:0:21316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789048861.718738:0:21316:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789048861.718749:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048861.718756:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048861.718763:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364a00 already unused, calling callback (ffffffffc1289c20) 00000100:00080000:0.0:1789048861.718763:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:00010000:1.0:1789048861.718766:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048861.718774:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048861.718774:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d74a80 x1875953111507072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1789048861.718782:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048861.718788:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789048861.718790:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789048861.718793:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1789048861.718795:0:21316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789048861.718800:0:21316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1789048861.718804:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00000100:00080000:0.0:1789048861.718805:0:21316:0:(import.c:65:import_set_state_nolock()) ffff959b07620000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1789048861.718808:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048861.718810:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789048861.718814:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d74a80 x1875953111507072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789048871 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789048861.718815:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08364a00/0x133f221c087772c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087772d0 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048861.718821:0:21316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789048861.718824:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:1.0:1789048861.718825:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048861.718827:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048861.718828:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048861.718883:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111507072:0@lo:38:kworker.0 00000100:00080000:0.0:1789048861.720817:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789048861.720831:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d77100 x1875953111507200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048862 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048861.720858:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c03e54a80 x1875953111507456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048864 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048861.720876:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d76300 x1875953111507584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048867 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048861.720896:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c03e55180 x1875953111507840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048869 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048861.720941:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959c03e55f80 x1875953111507968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048874 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048861.720949:0:21316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1789048861.720980:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111507840:0@lo:400:kworker.0 00000100:00080000:0.0:1789048861.721007:0:21316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789048861.721029:0:21316:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789048861.721115:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111507968:0@lo:400:kworker.0 00000100:00100000:2.0:1789048861.721125:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111507200:0@lo:400:kworker.0 00000100:00100000:3.0:1789048861.726180:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111507584:0@lo:400:kworker.0 00000100:00100000:3.0:1789048861.726261:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111508096:0@lo:39:umount.0 00000400:00000100:3.0:1789048861.726315:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875953111508096 offset 0 length 224: 4 00000100:00100000:1.0:1789048861.727163:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111507456:0@lo:400:kworker.0 00010000:00010000:0.0:1789048862.301560:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048863.325511:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789048863.709521:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789048863.709532:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789048864.349712:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048865.373577:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048866.403770:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048867.421534:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048868.445717:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789048868.829534:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048868.829574:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789048868.893559:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048853/real 1789048853] req@ffff959c03e54380 x1875953111507712/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789048868 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048868.893594:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c03e54380 x1875953111507712/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789048868 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048868.893615:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048868.893643:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789048868.893647:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111507712:0@lo:250:kworker.0 00000100:00080000:0.0:1789048868.893747:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789048868.893753:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789048868.893757:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048868.893762:0:36:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 607 00000100:00080000:0.0:1789048868.893767:0:36:0:(import.c:630:import_select_connection()) MGC192.168.202.116@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789048868.893779:0:36:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959c04ca3800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048868.893812:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d74000 x1875953111508224/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048868.897961:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111508224:0@lo:250:kworker.0 00000400:00000100:3.0:1789048868.898023:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875953111508224 offset 0 length 520: 4 00010000:00010000:1.0:1789048869.469765:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048870.493510:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048871.519406:0:20899:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048871.966607:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048861/real 1789048861] req@ffff959b05d76d80 x1875953111508096/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048871 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048871.966643:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b05d76d80 x1875953111508096/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789048871 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789048871.966686:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789048871.966713:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111508096:0@lo:39:umount.0 00000100:00080000:3.0:1789048871.968078:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789048871.968086:0:21316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789048871.968093:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789048871.969063:0:21316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969082:0:21316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969106:0:21316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969113:0:21316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969146:0:21316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048871.969154:0:21316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969161:0:21316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969168:0:21316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969174:0:21316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048871.969424:0:21316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789048871.969429:0:21316:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789048871.969458:0:21316:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789048871.969462:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789048871.969467:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048871.969473:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789048871.969477:0:21316:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff959c3945b380) has no exports 00000020:00080000:3.0:1789048871.969499:0:21316:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff959c3945b380) has no exports 00010000:00010000:0.0:1789048871.972790:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048871.972806:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972818:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365a00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048871.972823:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972833:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048871.972842:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048871.972847:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048871.972851:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789048871.972853:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789048871.972872:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:0.0:1789048871.972876:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972883:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08365a00/0x133f221c0877729f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c087772a6 expref: -99 pid: 19444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972898:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048871.972902:0:17110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972925:0:17110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048871.972928:0:17110:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972935:0:17110:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048871.972941:0:17110:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048871.972946:0:17110:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789048871.972948:0:17110:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789048871.972950:0:17110:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789048871.972968:0:17110:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:0.0:1789048871.972971:0:17110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972977:0:17110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07060200/0x133f221c08777489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777490 expref: -99 pid: 17119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048871.972989:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048871.972991:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048871.972993:0:17110:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048871.974947:0:17111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789048871.980771:0:21316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b08b5b120 - data ffff959c392ef798/ffff959b08caa000 00000020:01000000:3.0:1789048871.980940:0:21316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff959b076d7480 - data ffff959c391b2798/ffff959b08a09c00 00100000:10000000:3.0:1789048871.991288:0:21316:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789048872.012471:0:21316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087772b4 00000020:00000080:0.0:1789048872.012491:0:21316:0:(genops.c:885:class_export_put()) final put ffff959c2a76d800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789048872.012510:0:21316:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c3fb95000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789048872.012524:0:21316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3fb95000 2 00000020:01000004:0.0:1789048872.012528:0:21316:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff959c3fb95000 from lustre-OST0001 00000020:00000080:0.0:1789048872.012557:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048872.012590:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789048872.012594:0:21316:0:(genops.c:885:class_export_put()) final put ffff959c2a768800/lustre-OST0001_UUID 00000020:00000080:0.0:1789048872.012597:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2a768800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789048872.012604:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789048872.013394:0:21316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 41c76bec-8493-4b0e-a7d0-3ca4d71b9234->MGS 00010000:00010000:0.0:1789048872.013414:0:21316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048872.013428:0:21316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048872.013435:0:21316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789048872.013438:0:21316:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789048872.013441:0:21316:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789048872.013463:0:21316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:0.0:1789048872.013467:0:21316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08365800/0x133f221c08776fff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08777006 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048872.013484:0:21316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048872.013492:0:21316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048872.013498:0:21316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789048872.013501:0:21316:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789048872.013502:0:21316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789048872.013512:0:21316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff959c04ca3800 00010000:00010000:0.0:1789048872.013526:0:21316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b08365600/0x133f221c08776eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x133f221c08776ef5 expref: -99 pid: 17101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789048872.013543:0:21316:0:(import.c:65:import_set_state_nolock()) ffff959c04ca3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789048872.013556:0:21316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789048872.013558:0:21316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789048872.013561:0:21316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789048872.013630:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789048872.013717:0:21316:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff959b05d74000 x1875953111508224/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789048888 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789048872.013732:0:21316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789048872.013736:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1789048872.013826:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41c76bec-8493-4b0e-a7d0-3ca4d71b9234:3619:1875953111508224:0@lo:250:kworker.0 10000000:01000000:0.0:1789048872.013975:0:21316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789048872.013984:0:21316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08776ed9 00000020:00000080:0.0:1789048872.013989:0:21316:0:(genops.c:885:class_export_put()) final put ffff959b08807800/41c76bec-8493-4b0e-a7d0-3ca4d71b9234 00000020:01000000:0.0:1789048872.013997:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.116@tcp (flags='') 00000020:00000080:0.0:1789048872.014003:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048872.014009:0:21316:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789048872.014013:0:21316:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff959c20228000) has no exports 00000020:00000080:3.0:1789048872.014104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c2a76d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789048872.014114:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b08807800/41c76bec-8493-4b0e-a7d0-3ca4d71b9234 for MGC192.168.202.116@tcp 10000000:01000000:1.0:1789048872.014813:0:17119:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789048872.014915:0:21316:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.202.116@tcp: client import never connected 00000100:00080000:0.0:1789048872.014919:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789048872.014921:0:21316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789048872.014924:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789048872.014926:0:21316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789048872.015001:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789048872.015009:0:21316:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.116@tcp (uuid 41c76bec-8493-4b0e-a7d0-3ca4d71b9234) 00000020:01000000:0.0:1789048872.015016:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789048872.015020:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789048872.015024:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789048872.015030:0:21316:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff959b07626000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789048872.015036:0:21316:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff959b088b3380) has exports, disconnecting them 00000020:00080000:0.0:1789048872.015041:0:21316:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff959b07626000), last request at 1789048775 00000020:00000080:0.0:1789048872.015046:0:21316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087772de 00000020:00080000:0.0:1789048872.015058:0:21316:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959b07626000): rc 0 00000020:00000080:0.0:1789048872.015063:0:21316:0:(genops.c:885:class_export_put()) final put ffff959b07626000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789048872.015228:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959c04ca3800 for MGC192.168.202.116@tcp 00000020:00000080:3.0:1789048872.015236:0:36:0:(genops.c:885:class_export_put()) final put ffff959c04ca5000/41c76bec-8493-4b0e-a7d0-3ca4d71b9234 00000020:00000080:3.0:1789048872.015238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c04ca5000/41c76bec-8493-4b0e-a7d0-3ca4d71b9234 for MGC192.168.202.116@tcp 00000020:01000000:3.0:1789048872.015245:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.116@tcp (41c76bec-8493-4b0e-a7d0-3ca4d71b9234) 00010000:01000000:1.0:1789048872.017824:0:21316:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789048872.017832:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789048872.017836:0:21316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789048872.017843:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789048872.018402:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048872.018412:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789048872.018419:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789048872.018424:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048872.018428:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789048872.018435:0:21316:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff959c08adb800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789048872.018441:0:21316:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff959b088b4d40) has exports, disconnecting them 00000020:00080000:1.0:1789048872.018447:0:21316:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff959c08adb800), last request at 1789048775 00000020:00000080:1.0:1789048872.018451:0:21316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c087772f3 00000020:00080000:1.0:1789048872.018470:0:21316:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff959c08adb800): rc 0 00000020:00000080:1.0:1789048872.018476:0:21316:0:(genops.c:885:class_export_put()) final put ffff959c08adb800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789048872.019571:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b07626000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789048872.019588:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b07620000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789048872.019594:0:36:0:(genops.c:885:class_export_put()) final put ffff959b07625800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789048872.019596:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b07625800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789048872.019600:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789048872.019678:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959c08adb800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789048872.081999:0:21316:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789048872.082009:0:21316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789048872.082013:0:21316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789048872.082034:0:21316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789048872.082142:0:20899:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789048872.082224:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff959b07589000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789048872.082328:0:17110:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789048872.082490:0:17111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789048872.082941:0:17106:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff959c41529c00:17106] 1 exiting: rc = 0 00000100:00100000:3.0:1789048872.082956:0:17105:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff959c41528200:17105] 0 exiting: rc = 1 00000100:00100000:1.0:1789048872.083021:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.083300:0:17109:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff959c37fbd800:17109] 2 exiting: rc = 0 00000100:00100000:3.0:1789048872.083304:0:20898:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff959c41529600:20898] 3 exiting: rc = 0 00000100:00100000:0.0:1789048872.083392:0:17108:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff959c123be800:17108] 1 exiting: rc = 0 00000100:00100000:1.0:1789048872.083478:0:17107:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff959c4148b800:17107] 0 exiting: rc = 1 00000100:00100000:1.0:1789048872.085152:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085161:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085167:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085173:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085178:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085184:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085190:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085195:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085200:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085205:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085210:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085215:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085220:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085225:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085230:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085236:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085240:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085246:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085252:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085257:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085262:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085267:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085273:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085278:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085282:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085287:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085291:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085296:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085302:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085307:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085325:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085356:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085363:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085368:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085374:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085379:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085384:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085389:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085394:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085399:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085405:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085410:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085414:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085419:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085424:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085429:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085434:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085439:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085444:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085449:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085455:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085460:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085465:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085471:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085476:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085481:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085486:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085491:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085496:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085502:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085508:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085513:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085530:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.085535:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789048872.086898:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789048872.086920:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789048872.086927:0:21316:0:(genops.c:885:class_export_put()) final put ffff959b07622800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789048872.086932:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff959b07622800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789048872.086938:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789048872.086986:0:21316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3fb95000 1 00000020:00000080:1.0:1789048872.086992:0:21316:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x133f221c08777298 00000020:00000080:1.0:1789048872.086998:0:21316:0:(genops.c:885:class_export_put()) final put ffff959b076ea800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789048872.087017:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789048872.087021:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789048872.087026:0:21316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789048872.087030:0:21316:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff959b088b0000) has no exports 00000020:00000080:3.0:1789048872.087120:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff959b076ea800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789048872.112954:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048872.112968:0:21316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789048872.112973:0:21316:0:(genops.c:885:class_export_put()) final put ffff959c3fb90000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789048872.112978:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff959c3fb90000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789048872.112984:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789048872.113288:0:21316:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff959c3fb92800 00000020:01000000:3.0:1789048872.113308:0:21316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789048872.113314:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789048872.113319:0:21316:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789048872.113324:0:21316:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff959c394b99c0) has no exports 00000020:00000080:3.0:1789048872.113471:0:21316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789048872.113487:0:21316:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789048872.113490:0:21316:0:(genops.c:885:class_export_put()) final put ffff959b06954800/OSS_uuid 00000020:00000080:3.0:1789048872.113492:0:21316:0:(genops.c:844:class_export_destroy()) destroying export ffff959b06954800/OSS_uuid for OSS 00000020:01000000:3.0:1789048872.113496:0:21316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789048872.113668:0:18630:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff959b07813000:18630] 0 exiting: rc = 1 00000100:00100000:0.0:1789048872.113734:0:18912:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff959c3117ca00:18912] 3 exiting: rc = 0 00000100:00080000:1.0:1789048872.113832:0:17118:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789048872.113931:0:18632:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff959c2a5bde00:18632] 2 exiting: rc = 0 00000100:00100000:1.0:1789048872.114025:0:18631:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff959c32f36600:18631] 1 exiting: rc = 0 00000100:00100000:3.0:1789048872.114106:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114114:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114120:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114126:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114136:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114144:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114149:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114175:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114181:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114186:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114192:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114197:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114203:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114208:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114213:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114219:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114223:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114228:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114233:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114238:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114243:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114248:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114253:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114258:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114263:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114267:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114273:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114277:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114282:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114287:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114291:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114306:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114311:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114315:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114320:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114325:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114329:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114580:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114585:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114591:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114596:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114601:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114606:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114610:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114615:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114620:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114625:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114630:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114711:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114719:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114725:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114731:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114736:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114742:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114747:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114753:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114758:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114764:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114769:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114774:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114779:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114783:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114789:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.114800:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789048872.115885:0:18634:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff959b07812400:18634] 1 exiting: rc = 0 00000100:00100000:2.0:1789048872.115948:0:18633:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff959c3ebb1e00:18633] 0 exiting: rc = 1 00000100:00100000:3.0:1789048872.116011:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116017:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116035:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116041:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116046:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116051:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116056:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116062:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116067:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116073:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116078:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116084:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116088:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116099:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116108:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116113:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116118:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116123:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116128:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116134:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116139:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116145:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116150:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116154:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116159:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116164:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116169:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116174:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116179:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116185:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116192:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116197:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116202:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116207:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116212:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116217:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116222:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116234:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116239:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116243:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116248:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116253:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116257:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116262:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116267:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116272:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116276:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116281:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116287:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116293:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116300:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116305:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116310:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116316:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116321:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.116325:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117433:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117449:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117454:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117459:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117464:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117469:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117475:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.117479:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048872.118498:0:18635:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff959c2a51f200:18635] 0 exiting: rc = 1 00000100:00100000:3.0:1789048872.118499:0:18637:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff959c2a51f600:18637] 2 exiting: rc = 0 00000100:00100000:0.0:1789048872.118692:0:18636:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff959c2a51fe00:18636] 1 exiting: rc = 0 00000100:00100000:3.0:1789048872.118859:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118866:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118872:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118878:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118883:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118889:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118894:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118933:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118938:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118944:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118949:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118954:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118959:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118965:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118971:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118977:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118982:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118987:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118992:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.118998:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119003:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119009:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119026:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119032:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119038:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119044:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119050:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119055:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119061:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119067:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119073:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119080:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119086:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119091:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119098:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119104:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119109:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119115:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119121:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119128:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119135:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119140:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119155:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119160:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119165:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119171:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119428:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119439:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119445:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119451:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119456:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119461:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119466:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119472:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119486:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119497:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119503:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119508:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119535:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119542:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119548:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119554:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119560:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.119571:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789048872.136243:0:18638:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff959c2a51f400:18638] 0 exiting: rc = 1 00000100:00100000:3.0:1789048872.136450:0:18639:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff959c2a51f800:18639] 1 exiting: rc = 0 00000100:00100000:3.0:1789048872.136529:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136536:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136542:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136547:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136552:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136557:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136561:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136566:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136572:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136577:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136582:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136586:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136603:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136609:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136614:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136619:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136634:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136640:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136645:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136650:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136663:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136670:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136675:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136681:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136685:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136689:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136694:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136698:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136704:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136709:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136714:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136718:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136722:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136728:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136732:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136738:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136743:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136749:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136754:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136759:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136765:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136771:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136778:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136783:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136789:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136795:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136799:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136812:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136817:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136822:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136828:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136833:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136837:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136843:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136854:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136861:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136866:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136872:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136878:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136883:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136888:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136893:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136898:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.136904:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.137632:0:18640:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff959b0825ba00:18640] 0 exiting: rc = 1 00000100:00100000:1.0:1789048872.138211:0:18641:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff959b0825bc00:18641] 1 exiting: rc = 0 00000100:00100000:3.0:1789048872.138373:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138393:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138400:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138405:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138411:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138417:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138423:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138428:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138435:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138441:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138446:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138452:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138457:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138476:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138483:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138490:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138497:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138522:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138529:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138536:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138543:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138548:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138555:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138560:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138566:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138585:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138592:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138597:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138603:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138609:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138615:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138620:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138636:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138643:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138648:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138654:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138671:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138692:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138700:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138705:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138711:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138717:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138723:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138728:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138735:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138741:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138746:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138753:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138759:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138779:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138785:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138791:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138802:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138808:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138813:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138819:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138824:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138830:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138836:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138842:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138848:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138854:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138860:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789048872.138873:0:21316:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789048872.171671:0:21316:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789048892.697805:0:22081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789048904.249521:0:22683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789048904.249527:0:22683:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789048904.249528:0:22683:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789048904.249645:0:22683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c2e493000 00000020:01000004:2.0:1789048904.249661:0:22683:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789048904.249668:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789048904.249680:0:22683:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff959c394bcd40) 00000020:00000080:2.0:1789048904.249699:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789048904.303410:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789048904.304821:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789048904.306382:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.308667:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789048904.309046:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.309316:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789048904.309555:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.309747:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789048904.309947:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.310146:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.310400:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789048904.310573:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789048904.310799:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.310970:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789048904.311142:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789048904.311718:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789048904.311889:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789048904.312301:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789048904.312651:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789048904.312869:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789048904.313100:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789048904.313394:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789048904.313619:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789048904.313813:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789048904.314032:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.314572:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.314836:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.315038:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.315325:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.315672:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.315894:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.316131:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.316606:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.316849:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.317077:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.317477:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.317711:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.317913:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.318104:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.318548:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.318777:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.318972:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.319166:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.319462:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.319678:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.319894:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789048904.320117:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789048904.321247:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789048904.321720:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789048904.321937:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1789048904.322426:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789048904.322651:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789048904.322868:0:22683:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1789048904.323417:0:22683:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789048904.323636:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789048904.323644:0:22683:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789048904.323661:0:22683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c087777df 00000020:01000004:1.0:1789048904.323668:0:22683:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789048904.323673:0:22683:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789048904.323678:0:22683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c2e493000 from MGS 00000020:01000004:1.0:1789048904.323682:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789048904.323692:0:22683:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff959c39458000) 00000020:00000080:1.0:1789048904.323703:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789048904.323774:0:22683:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c2e493000 from MGS, refs=2 00080000:01000000:1.0:1789048904.323779:0:22683:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789048904.323792:0:22683:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c087777ed 00000100:00100000:1.0:1789048904.323890:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789048904.324034:0:22683:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789048904.324041:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789048904.324824:0:22683:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789048904.324832:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789048904.325576:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048904.325726:0:22683:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789048904.325731:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789048904.326108:0:22683:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789048904.326114:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789048904.326618:0:22683:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789048904.326624:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789048904.327385:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048904.327389:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048904.327391:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048904.327694:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048904.327697:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048904.327699:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048904.328710:0:22683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789048904.334779:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789048904.339449:0:22683:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789048904.342096:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789048904.344533:0:22683:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789048904.344602:0:22683:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789048904.345729:0:22683:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789048904.346049:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048904.348764:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789048904.348777:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789048904.357708:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789048904.357719:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789048904.364279:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789048904.364296:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789048904.374093:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789048904.374123:0:22683:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:2.0:1789048904.374125:0:22683:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789048904.374153:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:2.0:1789048904.374168:0:22683:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (ffff959c394b99c0) 00000020:00000080:2.0:1789048904.374198:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789048904.374446:0:22683:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b08807800@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048904.374602:0:22683:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:2.0:1789048904.374609:0:22683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789048904.376861:0:22700:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789048904.385583:0:22701:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789048904.394086:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid 2d3f2942-6380-4c90-a339-b9cf9971a742) 00000020:00000080:2.0:1789048904.394119:0:22683:0:(genops.c:1384:class_connect()) connect: client 2d3f2942-6380-4c90-a339-b9cf9971a742, cookie 0x133f221c087777fb 00000100:00080000:2.0:1789048904.394132:0:22683:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048904.394145:0:22683:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff959b08807800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048904.394196:0:22683:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a3800 x1875953111508352/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048904.394235:0:22683:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2d3f2942-6380-4c90-a339-b9cf9971a742->MGS 00000020:01000004:2.0:1789048904.394266:0:22683:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789048904.394285:0:22683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789048904.394300:0:22683:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff959c394b8000) 00000100:00100000:1.0:1789048904.394639:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d3f2942-6380-4c90-a339-b9cf9971a742:3619:1875953111508352:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789048904.394705:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.394810:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111508352 00000100:00100000:3.0:1789048904.394819:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111508352 00000100:00100000:3.0:1789048904.394851:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048904.394858:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c19ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3619:x1875953111508352:12345-0@lo:250:mount.lustre.0 00000020:00000080:2.0:1789048904.394898:0:22683:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00080000:3.0:1789048904.397750:0:22696:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 2d3f2942-6380-4c90-a339-b9cf9971a742@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:3.0:1789048904.397789:0:22696:0:(genops.c:1384:class_connect()) connect: client 2d3f2942-6380-4c90-a339-b9cf9971a742, cookie 0x133f221c08777809 00000100:00080000:3.0:1789048904.397943:0:22696:0:(import.c:65:import_set_state_nolock()) ffff959c3fb21000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048904.398041:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c19ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+5:3619:x1875953111508352:12345-0@lo:250:mount.lustre.0 Request processed in 3182us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.398054:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048904.398233:0:3619:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789048904.398244:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:1.0:1789048904.398261:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789048904.398266:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789048904.398270:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b08807800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789048904.398273:0:3619:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789048904.398290:0:3619:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789048904.398296:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2d3f2942-6380-4c90-a339-b9cf9971a742:3619:1875953111508352:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789048904.419811:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048904.420021:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789048904.420028:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789048904.424864:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789048904.424911:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789048904.425616:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789048904.425625:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789048904.431223:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048904.431452:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789048904.431458:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789048904.432614:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789048904.432624:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789048904.510536:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048904.510755:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789048904.510762:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789048904.512597:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789048904.512610:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789048904.521449:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048904.521645:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789048904.521651:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789048904.523949:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789048904.523962:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789048904.524823:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048904.525006:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789048904.525012:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789048904.526590:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789048904.526599:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789048904.527188:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048904.527411:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789048904.527416:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789048904.528020:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789048904.528025:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789048904.553876:0:22683:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789048904.554093:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789048904.554098:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789048904.556522:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789048904.556834:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789048904.563491:0:22683:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789048904.563509:0:22683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789048904.564737:0:22683:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789048904.564767:0:22683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789048904.564774:0:22683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789048904.564878:0:22683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789048904.564910:0:22683:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789048904.564915:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789048904.564917:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789048904.564918:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048904.564919:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048904.564920:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048904.564922:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048904.564924:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789048904.564925:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789048904.564927:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048904.564928:0:22683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789048904.564930:0:22683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789048904.564932:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789048904.564933:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789048904.564934:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048904.564935:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048904.564936:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048904.564937:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048904.564938:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789048904.564939:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789048904.564940:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048904.564941:0:22683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789048904.564966:0:22683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789048904.564986:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789048904.565069:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.565118:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef21480 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.565468:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111508480 00000100:00100000:3.0:1789048904.565477:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111508480 00000100:00100000:3.0:1789048904.565518:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048904.565527:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+5:22683:x1875953111508480:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048904.565574:0:22699:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789048904.565577:0:22699:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789048904.565581:0:22699:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789048904.565920:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789048904.566598:0:22699:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1789048904.568140:0:22721:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789048904.568147:0:22721:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789048904.568151:0:22721:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789048904.568154:0:22721:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789048904.568582:0:22721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789048904.568807:0:22699:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789048904.568818:0:22699:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789048904.574759:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+5:22683:x1875953111508480:12345-0@lo:253:mount.lustre.0 Request processed in 9221us (9679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.574776:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048904.574899:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508480:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789048904.574916:0:22683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789048904.574919:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789048904.574921:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789048904.574936:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048904.574937:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048904.574938:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048904.574939:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048904.574940:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789048904.574942:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789048904.574943:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048904.574945:0:22683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789048904.574965:0:22683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c2e493000 from lustre-MDT0000 10000000:01000000:1.0:1789048904.574999:0:22683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789048904.575001:0:22683:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789048904.575006:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff959c394b99c0 10000000:01000000:1.0:1789048904.575010:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048904.575019:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff959c394b99c0 from 1 10000000:01000000:1.0:1789048904.575022:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789048904.575063:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.575074:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.575084:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048904.575105:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508608:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048904.575142:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.575183:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c37fa1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.575263:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111508608 00000100:00100000:3.0:1789048904.575272:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111508608 00000100:00100000:3.0:1789048904.575321:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048904.575330:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+5:22683:x1875953111508608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048904.575364:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048904.575379:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3cc00/0x133f221c08777817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777810 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.575401:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3cc00/0x133f221c08777817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777810 expref: 6 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.575411:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3cc00/0x133f221c08777817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777810 expref: 6 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.575432:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3cc00, rc 0) 00000100:00100000:3.0:1789048904.575703:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+6:22683:x1875953111508608:12345-0@lo:101:mount.lustre.0 Request processed in 373us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.575710:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048904.577064:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048904.577089:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.577101:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048904.577184:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048904.581967:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048904.582027:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.582148:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111508736 00000100:00100000:2.0:1789048904.582158:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111508736 00000100:00100000:2.0:1789048904.582487:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048904.582503:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+6:22683:x1875953111508736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048904.582608:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+6:22683:x1875953111508736:12345-0@lo:501:mount.lustre.0 Request processed in 109us (652us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048904.582615:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048904.582864:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508736:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789048904.582912:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789048904.582935:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.582946:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048904.582962:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c2e493000 10000000:01000000:0.0:1789048904.582967:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048904.582972:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff959c2e493000 10000000:01000000:0.0:1789048904.582974:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789048904.582977:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff959c2e493000 from 1 10000000:01000000:0.0:1789048904.582980:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789048904.583015:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.583023:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.583034:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048904.583051:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048904.583083:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048904.583543:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.583732:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111508864 00000100:00100000:1.0:1789048904.583738:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111508864 00000100:00100000:1.0:1789048904.583773:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048904.583781:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+6:22683:x1875953111508864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048904.583794:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048904.583821:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061200/0x133f221c08777825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877781e expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.583846:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061200/0x133f221c08777825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877781e expref: 7 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.583857:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061200/0x133f221c08777825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877781e expref: 7 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.583866:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061200, rc 0) 00000100:00100000:1.0:1789048904.583914:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+7:22683:x1875953111508864:12345-0@lo:101:mount.lustre.0 Request processed in 133us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.583921:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048904.584021:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048904.584036:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777825 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.584046:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777825 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048904.584061:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789048904.584071:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777825 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.584083:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39a00/0x133f221c0877781e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777825 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048904.584090:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789048904.584094:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048904.584100:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff959c2e493000 10000000:01000000:0.0:1789048904.584102:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789048904.584107:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789048904.584109:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789048904.584129:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.584135:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.584143:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048904.584160:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048904.584187:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048904.584228:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.584547:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111508992 00000100:00100000:1.0:1789048904.584553:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111508992 00000100:00100000:1.0:1789048904.584574:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048904.584580:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+7:22683:x1875953111508992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048904.584587:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048904.584595:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07060200/0x133f221c08777833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877782c expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.584608:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07060200/0x133f221c08777833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877782c expref: 8 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.584616:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07060200/0x133f221c08777833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877782c expref: 8 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.584622:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060200, rc 0) 00000100:00100000:1.0:1789048904.584660:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+8:22683:x1875953111508992:12345-0@lo:101:mount.lustre.0 Request processed in 80us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.584675:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048904.584751:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111508992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048904.584762:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777833 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048904.584769:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777833 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048904.584840:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111509120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048904.584867:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048904.584899:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.584950:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111509120 00000100:00100000:1.0:1789048904.584955:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111509120 00000100:00100000:1.0:1789048904.584976:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048904.584981:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+8:22683:x1875953111509120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048904.585120:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22683:x1875953111509120:12345-0@lo:501:mount.lustre.0 Request processed in 138us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.585127:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789048904.585192:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111509120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048904.585243:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111509248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048904.585657:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048904.585669:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.585721:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111509248 00000100:00100000:1.0:1789048904.585726:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111509248 00000100:00100000:1.0:1789048904.585750:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048904.585757:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22683:x1875953111509248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048904.587066:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22683:x1875953111509248:12345-0@lo:503:mount.lustre.0 Request processed in 1305us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.587080:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048904.587212:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111509248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048904.591676:0:22722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22722:1875953111509376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789048904.591765:0:22722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048904.591811:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.591870:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111509376 00000100:00100000:2.0:1789048904.591878:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111509376 00000100:00100000:2.0:1789048904.591927:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048904.591938:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22722:x1875953111509376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048904.592897:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22722:x1875953111509376:12345-0@lo:502:llog_process_th.0 Request processed in 957us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.592907:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048904.593084:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22722:1875953111509376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789048904.593117:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048904.593128:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.593130:0:22722:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789048904.593136:0:22722:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789048904.593139:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048904.593152:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff959b088b19c0) 00000020:00000080:0.0:1789048904.593168:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789048904.593173:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789048904.593806:0:22722:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789048904.593816:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08777841 00000020:00000080:0.0:1789048904.594024:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789048904.594031:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048904.594035:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.594043:0:22722:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789048904.594047:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048904.594051:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.594052:0:22722:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789048904.594055:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048904.594064:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff959b088b0000) 00000020:00000080:0.0:1789048904.594075:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789048904.594079:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789048904.594080:0:22722:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789048904.594083:0:22722:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789048904.594088:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789048904.594142:0:22722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c2e493000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789048904.594156:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff959b088b4d40) 00000020:00000080:0.0:1789048904.594165:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789048904.595964:0:22722:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789048904.595985:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08777856 00000020:00000080:1.0:1789048904.596133:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789048904.596140:0:22722:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789048904.596146:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x133f221c0877785d 00080000:01000000:1.0:1789048904.596153:0:22722:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789048904.596157:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08777864 00010000:00010000:1.0:1789048904.732883:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789048904.733532:0:22722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934640 00000001:00080000:1.0:1789048904.734131:0:22722:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789048904.735877:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff959c394599c0) 00000020:00000080:1.0:1789048904.735899:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789048904.735997:0:22722:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789048904.736005:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08777872 00000020:00000080:1.0:1789048904.737035:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789048904.752228:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x133f221c08777879 00000020:00000080:0.0:1789048904.754357:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789048904.754371:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048904.754384:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.754386:0:22722:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789048904.754389:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789048904.754392:0:22722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789048904.754394:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048904.754395:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048904.754397:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789048904.754399:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.754401:0:22722:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789048904.754403:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048904.754408:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.754409:0:22722:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789048904.754414:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789048904.754460:0:22722:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789048904.754477:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048904.754480:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.754482:0:22722:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789048904.754498:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048904.754501:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.754502:0:22722:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789048904.754505:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789048904.754510:0:22722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:0.0:1789048904.754535:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048904.754551:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff959b088b3380) 00000020:00000080:0.0:1789048904.754571:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789048904.754576:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789048904.754646:0:22722:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789048904.754652:0:22722:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789048904.754660:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c08777887 00010000:00080000:0.0:1789048904.754691:0:22722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c05303000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048904.756385:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789048904.761185:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789048904.761211:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789048904.761259:0:22722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789048904.761281:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c0877788e 00000100:00080000:0.0:1789048904.761291:0:22722:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048904.761304:0:22722:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c05303000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048904.761376:0:22722:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d76d80 x1875953111509504/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048904.761398:0:22722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789048904.761448:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048904.761452:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.761454:0:22722:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789048904.761457:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789048904.761460:0:22722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789048904.761462:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048904.761463:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789048904.761465:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789048904.761472:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.761473:0:22722:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789048904.761476:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789048904.761481:0:22722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789048904.761484:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048904.761485:0:22722:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789048904.761488:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789048904.761492:0:22722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:0.0:1789048904.761512:0:22722:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789048904.761514:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789048904.761526:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff959b077eb380) 00000020:00000080:0.0:1789048904.761537:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789048904.761541:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789048904.761599:0:22722:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789048904.761605:0:22722:0:(osd_handler.c:8921:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789048904.761610:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c0877789c 00010000:00080000:0.0:1789048904.761636:0:22722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b07589000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:0.0:1789048904.761814:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789048904.762216:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111509504:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789048904.762289:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048904.762422:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111509504 00000100:00100000:2.0:1789048904.762431:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111509504 00000100:00100000:2.0:1789048904.762463:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048904.762471:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111509504:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1789048904.762487:0:22709:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1789048904.766556:0:22722:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789048904.766804:0:22722:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789048904.768613:0:22722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048904.769972:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789048904.783642:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789048904.786536:0:22728:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789048904.786545:0:22728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789048904.788407:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048904.788426:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789048904.788478:0:22722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789048904.788503:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c087778a3 00000100:00080000:1.0:1789048904.788516:0:22722:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048904.788529:0:22722:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959b07589000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048904.788568:0:22722:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd0380 x1875953111509632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048904.788598:0:22722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789048904.788662:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.788667:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.788670:0:22722:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789048904.788674:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789048904.788677:0:22722:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789048904.788679:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048904.788680:0:22722:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048904.788682:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789048904.788684:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.788686:0:22722:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789048904.788689:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048904.788693:0:22722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789048904.788697:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.788699:0:22722:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789048904.788716:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789048904.788720:0:22722:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789048904.788742:0:22722:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789048904.788745:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048904.788759:0:22722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff959c3945cd40) 00000020:00000080:1.0:1789048904.788774:0:22722:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789048904.788779:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789048904.788856:0:22722:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789048904.788863:0:22722:0:(osd_handler.c:8921:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789048904.788869:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x133f221c087778b1 00010000:00080000:1.0:1789048904.788899:0:22722:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c3e9d9800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048904.789120:0:22722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789048904.789214:0:22722:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789048904.789233:0:22722:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1789048904.789385:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111509632:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789048904.789446:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111509632 offset 0 length 520: 4 00000100:00100000:3.0:1789048904.790069:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111509504:12345-0@lo:38:llog_process_th.0 Request processed in 27595us (27776us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048904.790084:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789048904.790168:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048904.790174:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789048904.790178:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111509504:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789048904.793132:0:22722:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048904.793512:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789048904.793664:0:22722:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1789048904.794055:0:22730:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789048904.794060:0:22730:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789048904.794788:0:22722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789048904.794800:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789048904.794834:0:22722:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789048904.794852:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c087778b8 00000100:00080000:1.0:1789048904.794862:0:22722:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048904.794876:0:22722:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048904.794918:0:22722:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd3800 x1875953111509760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048904.794979:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111509760:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789048904.795032:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111509760 offset 0 length 520: 4 00000100:00080000:1.0:1789048904.795094:0:22722:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789048904.795156:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.795161:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.795162:0:22722:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789048904.795166:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048904.795175:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.795177:0:22722:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789048904.795181:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789048904.795183:0:22722:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789048904.795185:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.795187:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.795189:0:22722:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789048904.795191:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048904.795194:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.795195:0:22722:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789048904.795212:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789048904.795241:0:22722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22722:1875953111509888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048904.795298:0:22722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.795325:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111509888 00000100:00100000:1.0:1789048904.795356:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111509888 00000100:00100000:1.0:1789048904.795394:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048904.795402:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22722:x1875953111509888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048904.795498:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22722:x1875953111509888:12345-0@lo:502:llog_process_th.0 Request processed in 96us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.795506:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048904.795541:0:22722:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.795559:0:22722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22722:1875953111509888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048904.795581:0:22722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.795585:0:22722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.795586:0:22722:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789048904.795590:0:22722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789048904.795634:0:22683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789048904.795652:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789048904.795666:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777833 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795688:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef38a00/0x133f221c0877782c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777833 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048904.795697:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c2e493000 from 1 10000000:01000000:1.0:1789048904.795700:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048904.795722:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795730:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795740:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048904.795751:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048904.795774:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.795786:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.795806:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510016 00000100:00100000:1.0:1789048904.795810:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510016 00000100:00100000:1.0:1789048904.795827:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048904.795832:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+9:22683:x1875953111510016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048904.795841:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048904.795853:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087778bf expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795873:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087778bf expref: 10 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795894:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778bf expref: 10 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795902:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061800, rc 0) 00000100:00100000:1.0:1789048904.795930:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+10:22683:x1875953111510016:12345-0@lo:101:mount.lustre.0 Request processed in 97us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.795937:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048904.795967:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048904.795979:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.795988:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048904.796544:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510144:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789048904.796582:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.796600:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.796620:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510144 00000100:00100000:1.0:1789048904.796625:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510144 00000100:00100000:1.0:1789048904.796659:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048904.796667:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+10:22683:x1875953111510144:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789048904.796681:0:22699:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789048904.796687:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789048904.796748:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+10:22683:x1875953111510144:12345-0@lo:256:mount.lustre.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.796755:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048904.796839:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510144:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789048904.797407:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048904.797422:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797433:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048904.797441:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c2e493000 from 1 10000000:01000000:1.0:1789048904.797444:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048904.797468:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797477:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797486:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048904.797499:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048904.797529:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.797544:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.797567:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510272 00000100:00100000:1.0:1789048904.797571:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510272 00000100:00100000:1.0:1789048904.797597:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048904.797603:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+10:22683:x1875953111510272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048904.797612:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048904.797624:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087778cd expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797653:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087778cd expref: 11 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797663:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778cd expref: 11 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797672:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061000, rc 0) 00000100:00100000:1.0:1789048904.797699:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22683:x1875953111510272:12345-0@lo:101:mount.lustre.0 Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.797705:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789048904.797738:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048904.797750:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048904.797759:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048904.797803:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048904.797827:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.797839:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.797849:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510400 00000100:00100000:1.0:1789048904.797853:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510400 00000100:00100000:1.0:1789048904.797870:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048904.797875:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22683:x1875953111510400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048904.797988:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22683:x1875953111510400:12345-0@lo:501:mount.lustre.0 Request processed in 112us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.798002:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048904.798031:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048904.798054:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048904.798089:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.798102:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048904.798113:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510528 00000100:00100000:1.0:1789048904.798116:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510528 00000100:00100000:1.0:1789048904.798137:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789048904.798143:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22683:x1875953111510528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048904.799048:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22683:x1875953111510528:12345-0@lo:503:mount.lustre.0 Request processed in 901us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.799057:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048904.802857:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048904.805237:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22732:1875953111510656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048904.805365:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.805421:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.805608:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510656 00000100:00100000:2.0:1789048904.805616:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510656 00000100:00100000:2.0:1789048904.805670:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048904.805679:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22732:x1875953111510656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048904.806212:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22732:x1875953111510656:12345-0@lo:502:llog_process_th.0 Request processed in 531us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.806221:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048904.806397:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22732:1875953111510656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048904.806431:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048904.806441:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806444:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789048904.806452:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c2e493000 00000020:00000080:1.0:1789048904.806455:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048904.806464:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.806466:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806468:0:22732:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789048904.806470:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048904.806472:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806479:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789048904.806483:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c2e493000 00000020:00000080:1.0:1789048904.806485:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048904.806541:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.806545:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806546:0:22732:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789048904.806549:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048904.806552:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806554:0:22732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048904.806558:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c2e493000 00000020:00000080:1.0:1789048904.806560:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048904.806579:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.806582:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806583:0:22732:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048904.806586:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048904.806589:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.806591:0:22732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789048904.806594:0:22732:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c2e493000 00000020:00000080:1.0:1789048904.806597:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789048904.806635:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22732:1875953111510784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789048904.806676:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048904.806716:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11544780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.817299:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510784 00000100:00100000:2.0:1789048904.817317:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510784 00000100:00100000:2.0:1789048904.817410:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048904.817420:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22732:x1875953111510784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048904.817575:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22732:x1875953111510784:12345-0@lo:502:llog_process_th.0 Request processed in 156us (10899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.817583:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048904.820823:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22732:1875953111510784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789048904.820878:0:22732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048904.820889:0:22732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048904.820892:0:22732:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789048904.820897:0:22732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789048904.822088:0:22683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789048904.822116:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048904.822135:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.822148:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048904.822224:0:22683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789048904.822227:0:22683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c2e493000 10000000:01000000:3.0:1789048904.822230:0:22683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c2e493000 10000000:01000000:3.0:1789048904.822234:0:22683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789048904.822240:0:22683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c2e493000 from 1 10000000:01000000:3.0:1789048904.822252:0:22683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789048904.822288:0:22683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.822297:0:22683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.822307:0:22683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048904.822360:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048904.822419:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.822456:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c064cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.826373:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111510912 00000100:00100000:2.0:1789048904.826388:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111510912 00000100:00100000:2.0:1789048904.826435:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048904.826444:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22683:x1875953111510912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048904.826460:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048904.826479:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0a00/0x133f221c087778e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087778db expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.826506:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0a00/0x133f221c087778e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087778db expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.826517:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0a00/0x133f221c087778e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778db expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.826527:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0a00, rc 0) 00000100:00100000:2.0:1789048904.826593:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111510912:12345-0@lo:101:mount.lustre.0 Request processed in 150us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.826600:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048904.826710:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111510912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048904.826729:0:22683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778e2 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.826739:0:22683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087778e2 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048904.826810:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111511040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048904.826840:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.826878:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c064cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.827526:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511040 00000100:00100000:2.0:1789048904.827532:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511040 00000100:00100000:2.0:1789048904.827570:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048904.827578:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111511040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048904.827723:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111511040:12345-0@lo:501:mount.lustre.0 Request processed in 146us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.827747:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048904.827860:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111511040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048904.827895:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111511168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048904.827935:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.827959:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c064cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048904.828013:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511168 00000100:00100000:2.0:1789048904.828018:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511168 00000100:00100000:2.0:1789048904.828046:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048904.828052:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111511168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048904.828124:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111511168:12345-0@lo:503:mount.lustre.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.828130:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048904.828220:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111511168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048904.831672:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22737:1875953111511296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789048904.831752:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048904.831786:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c195dba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.831853:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511296 00000100:00100000:3.0:1789048904.831861:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511296 00000100:00100000:3.0:1789048904.831909:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048904.831919:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22737:x1875953111511296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048904.832047:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22737:x1875953111511296:12345-0@lo:502:llog_process_th.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.832064:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048904.832120:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22737:1875953111511296:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789048904.832180:0:22737:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789048904.832205:0:22737:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff959c2a424d40) 00000020:00000080:3.0:1789048904.832224:0:22737:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789048904.832415:0:22737:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c2e493000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789048904.832420:0:22737:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c2e493000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789048904.832422:0:22737:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c2e493000 4 00010000:00080000:3.0:1789048904.832455:0:22737:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b08d15000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789048904.837960:0:22737:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789048904.838213:0:22737:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789048904.841371:0:22737:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789048904.841392:0:22737:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x133f221c087778f0 00000100:00080000:3.0:1789048904.841403:0:22737:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048904.841418:0:22737:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff959b08d15000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048904.841457:0:22737:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c03e57100 x1875953111511424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048904.841483:0:22737:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789048904.844442:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111511424:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048904.844542:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.844950:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22737:1875953111511552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048904.845002:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.845033:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511552 00000100:00100000:3.0:1789048904.845040:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511552 00000100:00100000:3.0:1789048904.845083:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048904.845093:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22737:x1875953111511552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048904.845220:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22737:x1875953111511552:12345-0@lo:502:llog_process_th.0 Request processed in 128us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.845238:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048904.845292:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c064cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.845316:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22737:1875953111511552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048904.845386:0:22737:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22737:1875953111511680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048904.845417:0:22737:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.845439:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511680 00000100:00100000:3.0:1789048904.845443:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511680 00000100:00100000:3.0:1789048904.845466:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789048904.845472:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22737:x1875953111511680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789048904.845529:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22737:x1875953111511680:12345-0@lo:502:llog_process_th.0 Request processed in 57us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.845536:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789048904.845563:0:22737:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.845574:0:22737:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2d3f2942-6380-4c90-a339-b9cf9971a742:22737:1875953111511680:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789048904.845591:0:22737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789048904.845651:0:22683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789048904.845671:0:22683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789048904.845687:0:22683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778e2 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.845699:0:22683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c000/0x133f221c087778db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087778e2 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789048904.845743:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789048904.845745:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048904.845746:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048904.845751:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048904.845752:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048904.845754:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048904.845755:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048904.845756:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048904.845757:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048904.845759:0:22683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789048904.845762:0:22683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789048904.845764:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789048904.845765:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789048904.845766:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048904.845766:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048904.845767:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048904.845768:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048904.845769:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048904.845770:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789048904.845770:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048904.845771:0:22683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789048904.845783:0:22683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789048904.845790:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111511808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789048904.845816:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.845828:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.845849:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511808 00000100:00100000:3.0:1789048904.845852:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511808 00000100:00100000:3.0:1789048904.845876:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789048904.845882:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111511808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048904.845901:0:22696:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789048904.845916:0:22696:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789048904.846868:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511424 00000100:00100000:2.0:1789048904.846875:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511424 00000100:00100000:2.0:1789048904.846909:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048904.846915:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111511424:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789048904.846984:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111511424:12345-0@lo:38:llog_process_th.0 Request processed in 68us (2443us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048904.846990:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048904.848406:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789048904.848418:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b08d15000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048904.848423:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789048904.848428:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111511424:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1789048904.859814:0:22696:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789048904.859837:0:22696:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789048904.860221:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22683:x1875953111511808:12345-0@lo:253:mount.lustre.0 Request processed in 14333us (14398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048904.860266:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789048904.861408:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:22683:1875953111511808:0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048904.861427:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789048904.861431:0:22683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 10000000:01000000:3.0:1789048904.861433:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:2.0:1789048904.861435:0:22683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789048904.861436:0:22683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789048904.861438:0:22683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048904.861439:0:22683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048904.861440:0:22683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048904.861441:0:22683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048904.861442:0:22683:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048904.861444:0:22683:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789048904.861453:0:22683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048904.861455:0:22683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1789048904.861457:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1789048904.861471:0:22683:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789048904.861473:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778bf expref: 11 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.861490:0:22720:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.861526:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087778bf expref: 11 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.861542:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087778bf expref: 11 pid: 22697 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048904.861555:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111511936:0@lo:104: 00000100:00100000:3.0:1789048904.861599:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048904.861636:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c06540 going to sleep for 11 seconds 00000100:00100000:3.0:1789048904.862472:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111511936 00000100:00100000:3.0:1789048904.862485:0:22687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111511936 00000100:00100000:3.0:1789048904.862534:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048904.862543:0:22687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111511936:12345-0@lo:104: 00010000:00010000:3.0:1789048904.862558:0:22687:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.862623:0:22687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048904.862629:0:22687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111511936:12345-0@lo:104: Request processed in 88us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048904.862636:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048904.862671:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111511936:0@lo:104: 00010000:00010000:3.0:1789048904.862688:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.874164:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048904.874209:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.874222:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048904.874226:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.874236:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048904.874243:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048904.874249:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048904.874314:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.874321:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048904.874360:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.874368:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07060c00/0x133f221c087778bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087778c6 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.874385:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048904.874387:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048904.874389:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048904.874434:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111512064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048904.874501:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048904.876900:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512064 00000100:00100000:2.0:1789048904.876914:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512064 00010000:00010000:2.0:1789048904.876952:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087778bf expref: 12 pid: 22697 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048904.876992:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048904.877001:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:3620:x1875953111512064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048904.877015:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048904.877021:0:22689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087778bf expref: 12 pid: 22697 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877033:0:22689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087778bf expref: 12 pid: 22697 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877048:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061800/0x133f221c087778c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087778bf expref: 12 pid: 22697 timeout: 759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877063:0:22689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877071:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048904.877089:0:22689:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015656362s 00010000:00010000:2.0:1789048904.877093:0:22689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877099:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877117:0:22689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877124:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877130:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048904.877134:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877143:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877164:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048904.877174:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048904.877228:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.877243:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048904.877250:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3d800/0x133f221c087778f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048904.877262:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+11:3620:x1875953111512064:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048904.877269:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048904.877574:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111512064:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789048904.905638:0:22683:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967537 00000040:01000000:2.0:1789048904.905928:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789048904.906002:0:22743:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967537 00000020:00080000:3.0:1789048904.906006:0:22743:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967537 00000040:01000000:3.0:1789048904.906444:0:22744:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789048904.906698:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1789048904.906819:0:22744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789048904.908206:0:22745:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff959b080a1f80 x1875953111512192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048904.908220:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000040:01000000:0.0:1789048904.909381:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789048904.909416:0:22683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789048904.909906:0:22683:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789048904.909912:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789048904.909936:0:22683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048904.911023:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789048904.911627:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789048904.911653:0:22683:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789048904.915631:0:22744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789048904.915715:0:22744:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789048904.916598:0:22683:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789048904.917155:0:22683:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1789048904.920190:0:22683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789048904.930806:0:22683:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789048904.930850:0:22683:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb770c145b988 00100000:10000000:2.0:1789048904.930859:0:22683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789048904.935367:0:22683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789048904.935385:0:22683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789048904.935409:0:22683:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789048904.935425:0:22683:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789048904.936095:0:22683:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048904.939458:0:22683:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789048905.373513:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048905.886428:0:22739:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789048905.886444:0:22739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048905.887585:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789048905.887597:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789048905.951006:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 10000000:01000000:0.0:1789048906.077422:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789048906.077432:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c2e493000 from 11 10000000:01000000:0.0:1789048906.077438:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789048906.077486:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048906.077499:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048906.077526:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048906.077553:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111512320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789048906.077630:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048906.077736:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048906.081045:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512320 00000100:00100000:3.0:1789048906.081062:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512320 00000100:00100000:2.0:1789048906.085991:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789048906.086007:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+11:22701:x1875953111512320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048906.086026:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048906.086058:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087778fe expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048906.086088:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087778fe expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048906.086099:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778fe expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048906.086107:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1800, rc 0) 00000100:00100000:2.0:1789048906.086205:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22701:x1875953111512320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (8575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048906.086213:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789048906.086310:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111512320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048906.086328:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048906.086358:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048906.086429:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111512448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789048906.086467:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048906.088649:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048906.088751:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512448 00000100:00100000:3.0:1789048906.088769:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512448 00000100:00100000:3.0:1789048906.088818:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048906.088828:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22701:x1875953111512448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789048906.088850:0:22697:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789048906.088871:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789048906.088874:0:22697:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1789048906.089158:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:22701:x1875953111512448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 331us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048906.089166:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789048906.089531:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111512448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789048906.089586:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789048906.089595:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048906.089606:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048906.400007:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048906.916085:0:22739:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789048906.916095:0:22739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048906.916247:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1789048906.916395:0:22739:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789048906.916570:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1789048906.975194:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:3.0:1789048907.424277:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048908.005585:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:2.0:1789048908.448842:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048909.021417:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:2.0:1789048909.469473:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789048909.821786:0:22987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789048910.045473:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000100:00080000:0.0:1789048910.303782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789048910.303805:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789048910.303809:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048910.303816:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:0.0:1789048910.303822:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789048910.303833:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c05303000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048910.303859:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d76680 x1875953111512704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048910.303872:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048910.303875:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048910.303878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048910.303881:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048910.303884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789048910.303887:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789048910.303888:0:37:0:(import.c:65:import_set_state_nolock()) ffff959b08d15000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048910.303894:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff959b08d15000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048910.303907:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d77b80 x1875953111512832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048910.304085:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111512704:0@lo:38:kworker.0 00000100:00100000:3.0:1789048910.304164:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048910.304226:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111512832:0@lo:38:kworker.0 00000100:00100000:3.0:1789048910.304252:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048910.304282:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111512576:0@lo:400:kworker.0 00000100:00100000:3.0:1789048910.304311:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048910.304369:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512576 00000100:00100000:3.0:1789048910.304378:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512576 00000100:00100000:3.0:1789048910.304425:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048910.304433:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:3621:x1875953111512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048910.304503:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:3621:x1875953111512576:12345-0@lo:400:kworker.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048910.304510:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048910.304555:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111512576:0@lo:400:kworker.0 00000100:00100000:0.0:1789048910.305141:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512704 00000100:00100000:0.0:1789048910.305159:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512704 00000100:00100000:0.0:1789048910.305188:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048910.305199:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111512704:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789048910.305219:0:22710:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789048910.305268:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111512704:12345-0@lo:38:kworker.0 Request processed in 68us (1104us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789048910.305285:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048910.305401:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512832 00000100:00100000:1.0:1789048910.305406:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512832 00000100:00100000:1.0:1789048910.305490:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048910.305497:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111512832:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789048910.305516:0:22706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1789048910.305561:0:22706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x133f221c0877790c 00000004:00100000:1.0:1789048910.305577:0:22706:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789048910.305734:0:22706:0:(import.c:65:import_set_state_nolock()) ffff959c3fcc1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048910.305778:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875953111512832:12345-0@lo:38:kworker.0 Request processed in 281us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048910.305784:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789048910.306307:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048910.306314:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789048910.306318:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111512704:0@lo:38:kworker.0 00010000:00080000:3.0:1789048910.306372:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959b05d77b80 x1875953111512832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048910.306387:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789048910.306419:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789048910.306441:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789048910.306444:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b08d15000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048910.306450:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875953111512832:0@lo:38:kworker.0 00010000:00010000:3.0:1789048910.500212:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048910.888849:0:23040:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048910.889050:0:23040:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789048911.072035:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:0.0:1789048911.523832:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789048911.806016:0:23090:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048911.806229:0:23090:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789048912.093491:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:1.0:1789048912.543071:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048913.120807:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:0.0:1789048913.565818:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048914.141489:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000100:00100000:0.0:1789048914.397497:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048904/real 1789048904] req@ffff959c3fcd3800 x1875953111509760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048914.397530:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c3fcd3800 x1875953111509760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048914.397541:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048904/real 1789048904] req@ffff959c3fcd0380 x1875953111509632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048914 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048914.397552:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c3fcd0380 x1875953111509632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048914 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789048914.397572:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048914.397595:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789048914.397599:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111509760:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789048914.397605:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789048914.397610:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789048914.397613:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111509632:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789048914.397854:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789048914.397859:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789048914.397862:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048914.397921:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 665 00000100:00080000:2.0:1789048914.397926:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048914.397938:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c05303000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048914.397959:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a0a80 x1875953111513088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048914.397977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048914.397981:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789048914.397982:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048914.397985:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:2.0:1789048914.397988:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789048914.397991:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959b07589000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048914.398002:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a2300 x1875953111513216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048914.398010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048914.398013:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048914.398014:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048914.398017:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 659 00000100:00080000:2.0:1789048914.398019:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789048914.398023:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048914.398035:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a1c00 x1875953111513344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048914.398145:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111512960:0@lo:400:kworker.0 00000100:00100000:0.0:1789048914.398217:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048914.398278:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048914.398285:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111513472:0@lo:400:kworker.0 00000100:00100000:0.0:1789048914.398353:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048914.398400:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111513472 00000100:00100000:0.0:1789048914.398408:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111513472 00000100:00100000:0.0:1789048914.398450:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789048914.398459:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111513472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048914.398508:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111513472:12345-0@lo:400:kworker.0 Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048914.398515:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789048914.398552:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959b080a3800 x1875953111513472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048914.398563:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111513472:0@lo:400:kworker.0 00000100:00100000:2.0:1789048914.398636:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512960 00000100:00100000:2.0:1789048914.398647:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512960 00000100:00100000:2.0:1789048914.398684:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048914.398691:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:3622:x1875953111512960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048914.398727:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:3622:x1875953111512960:12345-0@lo:400:kworker.0 Request processed in 37us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048914.398733:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789048914.398889:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111512960:0@lo:400:kworker.0 00000100:00100000:1.0:1789048914.398996:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111513088:0@lo:38:kworker.0 00000100:00100000:1.0:1789048914.399058:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048914.399089:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111513216:0@lo:8:kworker.0 00000400:00000100:1.0:1789048914.399123:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111513216 offset 0 length 520: 4 00000100:00100000:1.0:1789048914.399142:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111513344:0@lo:8:kworker.0 00000400:00000100:1.0:1789048914.399159:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111513344 offset 0 length 520: 4 00000100:00100000:3.0:1789048914.399227:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111513088 00000100:00100000:3.0:1789048914.399232:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111513088 00000100:00100000:3.0:1789048914.399261:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048914.399267:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111513088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789048914.399283:0:22710:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789048914.399318:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3619:x1875953111513088:12345-0@lo:38:kworker.0 Request processed in 49us (258us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789048914.399323:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789048914.399522:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048914.399535:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048914.399539:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111513088:0@lo:38:kworker.0 00010000:00010000:1.0:1789048914.590599:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048915.165433:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:0.0:1789048915.615465:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789048916.137387:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048916.190795:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:1.0:1789048916.642501:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048917.213490:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:0.0:1789048917.664450:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048918.238443:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:1.0:1789048918.686077:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789048919.008103:0:23436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789048919.008108:0:23436:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789048919.008110:0:23436:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789048919.008246:0:23436:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c3fcc0000 00000020:01000004:1.0:1789048919.008262:0:23436:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789048919.008274:0:23436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789048919.008288:0:23436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff959c3945b380) 00000020:00000080:1.0:1789048919.008304:0:23436:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789048919.190776:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789048919.198934:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789048919.201747:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789048919.203609:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.214097:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.214886:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.215195:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.217463:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.217846:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.218253:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.218716:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.218992:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.219707:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.219991:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.220540:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.220798:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.221020:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.221555:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.221756:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.221981:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.222281:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.222949:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.223239:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.223554:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.223752:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.224005:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.224325:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.224750:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.224943:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.225296:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.225631:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.225827:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.226013:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1789048919.226367:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789048919.228024:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789048919.228694:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789048919.228923:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789048919.229135:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789048919.229523:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789048919.229713:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789048919.229941:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789048919.230250:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789048919.230705:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789048919.230949:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789048919.231303:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789048919.231662:0:23436:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:01000000:0.0:1789048919.233893:0:23436:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789048919.234157:0:23436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789048919.234169:0:23436:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789048919.234182:0:23436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c0877791a 00000020:01000004:0.0:1789048919.234195:0:23436:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789048919.234219:0:23436:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789048919.234223:0:23436:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789048919.234229:0:23436:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789048919.234256:0:23436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789048919.234260:0:23436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789048919.249375:0:23436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789048919.249428:0:23436:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789048919.249434:0:23436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789048919.249436:0:23436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048919.249437:0:23436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048919.249438:0:23436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048919.249440:0:23436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048919.249441:0:23436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048919.249442:0:23436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048919.249444:0:23436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048919.249445:0:23436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789048919.249449:0:23436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789048919.249451:0:23436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048919.249452:0:23436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048919.249453:0:23436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048919.249454:0:23436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048919.249456:0:23436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048919.249457:0:23436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048919.249458:0:23436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048919.249459:0:23436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048919.249460:0:23436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789048919.249489:0:23436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789048919.249511:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048919.249586:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048919.249654:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c11c423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.249809:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111513600 00000100:00100000:3.0:1789048919.249819:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111513600 00000100:00100000:3.0:1789048919.249880:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789048919.249890:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:23436:x1875953111513600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048919.249921:0:22696:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789048919.249925:0:22696:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789048919.249932:0:22696:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789048919.250378:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+12:23436:x1875953111513600:12345-0@lo:253:mount.lustre.0 Request processed in 488us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.250398:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789048919.251195:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513600:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048919.251212:0:23436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789048919.251216:0:23436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048919.251217:0:23436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789048919.251219:0:23436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048919.251220:0:23436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048919.251221:0:23436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048919.251222:0:23436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048919.251224:0:23436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789048919.251226:0:23436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048919.251227:0:23436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789048919.251250:0:23436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c3fcc0000 from lustre-MDT0001 10000000:01000000:0.0:1789048919.251283:0:23436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789048919.251286:0:23436:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789048919.251294:0:23436:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c394b99c0 local copy 00010000:00010000:0.0:1789048919.251305:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048919.251472:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513728:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048919.251528:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048919.251571:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111513728 00000100:00100000:0.0:1789048919.251577:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111513728 00000100:00100000:0.0:1789048919.251613:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048919.251621:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:23436:x1875953111513728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048919.251679:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+12:23436:x1875953111513728:12345-0@lo:501:mount.lustre.0 Request processed in 58us (151us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048919.251692:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789048919.251735:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.251749:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513728:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789048919.251760:0:23436:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789048919.251776:0:23436:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789048919.251783:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048919.251792:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048919.251818:0:23436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c3fcc0000 10000000:01000000:0.0:1789048919.251823:0:23436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048919.251828:0:23436:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff959c394b99c0 10000000:01000000:0.0:1789048919.251831:0:23436:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789048919.251834:0:23436:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff959c394b99c0 from 1 10000000:01000000:0.0:1789048919.251836:0:23436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789048919.251858:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048919.251866:0:23436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048919.251876:0:23436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048919.251889:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048919.251913:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048919.251947:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4153e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.252143:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111513856 00000100:00100000:2.0:1789048919.252154:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111513856 00000100:00100000:2.0:1789048919.252187:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048919.252194:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+12:23436:x1875953111513856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048919.252202:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048919.252214:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0200/0x133f221c08777928 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777921 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.252246:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0200/0x133f221c08777928 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777921 expref: 13 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.252257:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0200/0x133f221c08777928 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777921 expref: 13 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.252265:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0200, rc 0) 00000100:00100000:2.0:1789048919.252307:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+13:23436:x1875953111513856:12345-0@lo:101:mount.lustre.0 Request processed in 114us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.252314:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789048919.252471:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048919.252485:0:23436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777928 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.252502:0:23436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777928 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048919.252519:0:23436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789048919.252532:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777928 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.252538:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef38c00/0x133f221c08777921 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777928 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048919.252546:0:23436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff959c3fcc0000 10000000:01000000:1.0:1789048919.252551:0:23436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789048919.252554:0:23436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff959c3fcc0000 from 1 10000000:01000000:1.0:1789048919.252556:0:23436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789048919.252573:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.252581:0:23436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.252588:0:23436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048919.252601:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048919.252629:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048919.252651:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.252764:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111513984 00000100:00100000:3.0:1789048919.252776:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111513984 00000100:00100000:3.0:1789048919.252818:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789048919.252826:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+13:23436:x1875953111513984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048919.252834:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048919.252843:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3d800/0x133f221c08777936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877792f expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.252859:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3d800/0x133f221c08777936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877792f expref: 14 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.252868:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3d800/0x133f221c08777936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877792f expref: 14 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.252875:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d800, rc 0) 00000100:00100000:3.0:1789048919.252906:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+14:23436:x1875953111513984:12345-0@lo:101:mount.lustre.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.252914:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789048919.253100:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111513984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048919.253118:0:23436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777936 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.253133:0:23436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777936 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048919.253149:0:23436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789048919.253165:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777936 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.253172:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061e00/0x133f221c0877792f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777936 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048919.253178:0:23436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789048919.253182:0:23436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048919.253187:0:23436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff959c3fcc0000 10000000:01000000:1.0:1789048919.253189:0:23436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789048919.253192:0:23436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789048919.253194:0:23436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789048919.253208:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.253214:0:23436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.253221:0:23436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048919.253234:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048919.253261:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048919.253291:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.253371:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514112 00000100:00100000:3.0:1789048919.253376:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514112 00000100:00100000:3.0:1789048919.253411:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789048919.253418:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+14:23436:x1875953111514112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048919.253425:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048919.253434:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3da00/0x133f221c08777944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c0877793d expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.253448:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3da00/0x133f221c08777944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c0877793d expref: 15 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.253455:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3da00/0x133f221c08777944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c0877793d expref: 15 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.253468:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3da00, rc 0) 00000100:00100000:3.0:1789048919.253509:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514112:12345-0@lo:101:mount.lustre.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.253514:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789048919.253909:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048919.253922:0:23436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777944 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.253931:0:23436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777944 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048919.256594:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:2.0:1789048919.261439:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000040:00080000:0.0:1789048919.270194:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048919.282458:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789048919.282533:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789048919.282550:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789048919.282566:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789048919.282580:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789048919.282595:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789048919.282609:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789048919.282623:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789048919.282637:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789048919.282651:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789048919.282665:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789048919.282680:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789048919.282695:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789048919.282724:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789048919.282739:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789048919.282755:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789048919.282768:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789048919.282780:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789048919.282795:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789048919.282809:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789048919.282822:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789048919.282837:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789048919.282852:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789048919.282869:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789048919.282885:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789048919.282900:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789048919.282917:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789048919.282932:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789048919.282945:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789048919.282958:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789048919.282972:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789048919.282985:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789048919.282999:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789048919.283011:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789048919.283023:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789048919.283036:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789048919.283050:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789048919.283078:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789048919.284447:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789048919.284514:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789048919.284533:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789048919.284548:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789048919.284562:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789048919.284576:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789048919.284605:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789048919.284611:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789048919.284758:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048919.284830:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048919.285498:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c1871a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.289813:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514240 00000100:00100000:0.0:1789048919.289830:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514240 00000100:00100000:2.0:1789048919.289956:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048919.289967:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048919.290437:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514240:12345-0@lo:501:mount.lustre.0 Request processed in 470us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.290446:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789048919.290573:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048919.290630:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048919.290688:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048919.290717:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c41497d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.290785:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514368 00000100:00100000:2.0:1789048919.290791:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514368 00000100:00100000:2.0:1789048919.290857:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048919.290865:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048919.291779:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514368:12345-0@lo:503:mount.lustre.0 Request processed in 910us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.291789:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048919.293283:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789048919.294764:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048919.294912:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048919.294997:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.295049:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.295132:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514496 00000100:00100000:0.0:1789048919.295139:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514496 00000100:00100000:0.0:1789048919.295189:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789048919.295199:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048919.296207:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514496:12345-0@lo:502:mount.lustre.0 Request processed in 1004us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.296219:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789048919.296323:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048919.296602:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789048919.296634:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789048919.296649:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789048919.296664:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789048919.296679:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789048919.296693:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789048919.296707:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789048919.296721:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789048919.296735:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789048919.296747:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789048919.296759:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789048919.296774:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789048919.296788:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789048919.296800:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789048919.296814:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789048919.296829:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789048919.296843:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789048919.296870:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789048919.296887:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789048919.296902:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789048919.296917:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789048919.296930:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789048919.296944:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789048919.296960:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789048919.296973:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789048919.296987:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789048919.297002:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789048919.297016:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789048919.297033:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789048919.297049:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789048919.297075:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789048919.297090:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789048919.297285:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789048919.297310:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789048919.297325:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789048919.297386:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789048919.297401:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789048919.297413:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789048919.297426:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789048919.297443:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789048919.297459:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789048919.297473:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789048919.298203:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789048919.298230:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789048919.298278:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048919.298387:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.298423:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.298703:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514624 00000100:00100000:0.0:1789048919.298713:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514624 00000100:00100000:0.0:1789048919.298774:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789048919.298784:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048919.298915:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111514624:12345-0@lo:502:mount.lustre.0 Request processed in 131us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.298923:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048919.299375:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111514624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048919.299447:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789048919.299457:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789048919.301699:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048919.301714:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.301717:0:23440:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789048919.301724:0:23440:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789048919.301727:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048919.301744:0:23440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff959c03e43380) 00000020:00000080:1.0:1789048919.301771:0:23440:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789048919.301776:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789048919.301879:0:23440:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789048919.301886:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777952 00000020:00000080:1.0:1789048919.302278:0:23440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789048919.302284:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048919.302289:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.302291:0:23440:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789048919.302293:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048919.302297:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.302298:0:23440:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789048919.302301:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048919.302314:0:23440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff959c03e44d40) 00000020:00000080:1.0:1789048919.302325:0:23440:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789048919.302329:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789048919.302366:0:23440:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789048919.302369:0:23440:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789048919.302377:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789048919.302424:0:23440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3fcc0000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789048919.302435:0:23440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff959c03e40000) 00000020:00000080:1.0:1789048919.302443:0:23440:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789048919.302591:0:23440:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789048919.302596:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777967 00000020:00000080:1.0:1789048919.302687:0:23440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789048919.302694:0:23440:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789048919.302698:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x133f221c0877796e 00080000:01000000:1.0:1789048919.302703:0:23440:0:(osd_handler.c:8921:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789048919.302705:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777975 00010000:00010000:0.0:1789048919.434858:0:23440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1789048919.435845:0:23440:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:0.0:1789048919.436461:0:23440:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789048919.437391:0:23440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789048919.437404:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048919.437411:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.437413:0:23440:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789048919.437417:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048919.437422:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.437424:0:23440:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789048919.437427:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789048919.437433:0:23440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:1.0:1789048919.437461:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048919.437474:0:23440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff959c03e419c0) 00000020:00000080:1.0:1789048919.437495:0:23440:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789048919.437501:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789048919.437561:0:23440:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789048919.437567:0:23440:0:(osd_handler.c:8921:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789048919.437574:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777983 00010000:00080000:1.0:1789048919.437608:0:23440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c0398b800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048919.438973:0:23440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789048919.442668:0:23440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789048919.442688:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789048919.442743:0:23440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789048919.442771:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c0877798a 00000100:00080000:1.0:1789048919.442784:0:23440:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048919.442798:0:23440:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff959c0398b800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048919.442858:0:23440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd2a00 x1875953111514752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048919.445317:0:23440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789048919.445427:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048919.445433:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.445435:0:23440:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789048919.445439:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789048919.445441:0:23440:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789048919.445443:0:23440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048919.445444:0:23440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048919.445446:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789048919.445448:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.445449:0:23440:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789048919.445451:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048919.445456:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.445457:0:23440:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789048919.445460:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789048919.445507:0:23440:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789048919.445522:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048919.445524:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.445526:0:23440:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789048919.445528:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789048919.445530:0:23440:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789048919.445531:0:23440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048919.445539:0:23440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048919.445541:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789048919.445544:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.445545:0:23440:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789048919.445547:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048919.445551:0:23440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789048919.445554:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.445555:0:23440:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789048919.445558:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789048919.445562:0:23440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789048919.445586:0:23440:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789048919.445588:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048919.445604:0:23440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff959c20a03380) 00000020:00000080:1.0:1789048919.445621:0:23440:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789048919.445625:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789048919.445704:0:23440:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789048919.445711:0:23440:0:(osd_handler.c:8921:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789048919.445716:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c08777998 00010000:00080000:1.0:1789048919.445748:0:23440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b06839800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048919.445964:0:23440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:0.0:1789048919.446915:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789048919.446923:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789048919.446928:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048919.446936:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:0.0:1789048919.446942:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789048919.446952:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c05303000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048919.446996:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d76a00 x1875953111514880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048919.447013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048919.447017:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048919.447019:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048919.447022:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048919.447103:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111515008:0@lo:400:kworker.0 00000100:00100000:0.0:1789048919.447179:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048919.447232:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111515008 00000100:00100000:0.0:1789048919.447240:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111515008 00000100:00100000:0.0:1789048919.447286:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789048919.447295:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111515008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048919.447373:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111515008:12345-0@lo:400:kworker.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.447381:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789048919.447425:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959b05d77480 x1875953111515008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048919.447439:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111515008:0@lo:400:kworker.0 00000100:00100000:3.0:1789048919.447987:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111514752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789048919.448107:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.448139:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111514880:0@lo:38:kworker.0 00000100:00100000:3.0:1789048919.448162:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048919.448535:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514752 00000100:00100000:2.0:1789048919.448541:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514752 00000100:00100000:2.0:1789048919.448562:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111514880 00000100:00100000:2.0:1789048919.448564:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111514880 00000100:00100000:2.0:1789048919.448574:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789048919.448580:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111514752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789048919.448604:0:22709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:2.0:1789048919.448637:0:22709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c0877799f 00000004:00100000:2.0:1789048919.448651:0:22709:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789048919.448656:0:22709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:2.0:1789048919.453639:0:23440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789048919.457124:0:23440:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789048919.465252:0:22709:0:(import.c:65:import_set_state_nolock()) ffff959b08013000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048919.465453:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111514752:12345-0@lo:38:llog_process_th.0 Request processed in 16868us (17342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.465465:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048919.465500:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048919.465505:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111514880:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789048919.465509:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048919.465521:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789048919.465533:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:3.0:1789048919.465540:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789048919.465543:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c0398b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789048919.465561:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111514880:12345-0@lo:38:kworker.0 Request processed in 54us (17398us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789048919.465563:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111514752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789048919.465567:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048919.465576:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048919.465580:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789048919.465583:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789048919.465586:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111514880:0@lo:38:kworker.0 00000100:00100000:3.0:1789048919.465743:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111515136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048919.465782:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048919.473082:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111515136 00000100:00100000:0.0:1789048919.473101:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111515136 00000100:00100000:0.0:1789048919.473187:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048919.473198:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111515136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048919.473240:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789048919.473360:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111515136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (7576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.473367:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048919.473398:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111515136:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789048919.474588:0:23440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048919.475099:0:23440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789048919.475276:0:23440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789048919.485754:0:23445:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789048919.485762:0:23445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789048919.486708:0:23440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789048919.486722:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789048919.486761:0:23440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789048919.486789:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c087779a6 00000100:00080000:1.0:1789048919.486803:0:23440:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048919.486815:0:23440:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959b06839800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048919.487008:0:23440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd0000 x1875953111515264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048919.487122:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111515264:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789048919.487184:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111515264 offset 0 length 520: 4 00000100:00080000:1.0:1789048919.487296:0:23440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789048919.487387:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048919.487392:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.487394:0:23440:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789048919.487397:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789048919.487400:0:23440:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789048919.487402:0:23440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048919.487404:0:23440:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789048919.487406:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789048919.487408:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.487409:0:23440:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789048919.487412:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048919.487416:0:23440:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789048919.487419:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048919.487421:0:23440:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789048919.487423:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789048919.487427:0:23440:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789048919.487448:0:23440:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789048919.487451:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048919.487464:0:23440:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff959c20a00000) 00000020:00000080:1.0:1789048919.487479:0:23440:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789048919.487483:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789048919.487559:0:23440:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789048919.487567:0:23440:0:(osd_handler.c:8921:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789048919.487573:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x133f221c087779b4 00010000:00080000:1.0:1789048919.487611:0:23440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c3fb93800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048919.487886:0:23440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789048919.487962:0:23440:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789048919.487978:0:23440:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789048919.488394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048919.488399:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048919.488403:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048919.488406:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789048919.491029:0:23440:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048919.491525:0:23440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789048919.491673:0:23440:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1789048919.494929:0:23447:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789048919.494937:0:23447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789048919.499722:0:23440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789048919.499741:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789048919.499815:0:23440:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789048919.499841:0:23440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c087779bb 00000100:00080000:0.0:1789048919.499868:0:23440:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789048919.500114:0:23440:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048919.500156:0:23440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d77480 x1875953111515392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048919.500235:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111515392:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789048919.500292:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111515392 offset 0 length 520: 4 00000100:00080000:0.0:1789048919.500410:0:23440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789048919.500469:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048919.500473:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048919.500480:0:23440:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789048919.500483:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048919.500487:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048919.500489:0:23440:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789048919.500492:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789048919.500494:0:23440:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789048919.500496:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048919.500498:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048919.500499:0:23440:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789048919.500501:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789048919.500503:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048919.500505:0:23440:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789048919.500508:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789048919.500544:0:23440:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789048919.500548:0:23440:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789048919.500549:0:23440:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789048919.500552:0:23440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:1.0:1789048919.500790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048919.500796:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048919.500799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048919.500801:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1789048919.501186:0:23436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789048919.501216:0:23436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789048919.501236:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777944 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.501247:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061a00/0x133f221c0877793d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777944 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048919.501255:0:23436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c3fcc0000 from 1 10000000:01000000:3.0:1789048919.501257:0:23436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789048919.501285:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.501294:0:23436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.501303:0:23436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.501321:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048919.501391:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.501546:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.502222:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111515520 00000100:00100000:2.0:1789048919.502231:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111515520 00000100:00100000:2.0:1789048919.502369:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048919.502380:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+15:23436:x1875953111515520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048919.502395:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048919.502412:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087779c2 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.502442:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087779c2 expref: 16 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.502453:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087779c2 expref: 16 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.502461:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0600, rc 0) 00000100:00100000:2.0:1789048919.502525:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+16:23436:x1875953111515520:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.502532:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048919.502629:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048919.502646:0:23436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.502655:0:23436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.503240:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515648:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789048919.503289:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.504154:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.504358:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111515648 00000100:00100000:0.0:1789048919.504367:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111515648 00000100:00100000:0.0:1789048919.504413:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789048919.504422:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+16:23436:x1875953111515648:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789048919.504445:0:22699:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789048919.504468:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789048919.504472:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789048919.504567:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+16:23436:x1875953111515648:12345-0@lo:256:mount.lustre.0 Request processed in 146us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.504575:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048919.504662:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515648:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789048919.505558:0:23436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789048919.505581:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.505595:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048919.505605:0:23436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3fcc0000 from 1 10000000:01000000:3.0:1789048919.505608:0:23436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048919.505641:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.505649:0:23436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.505659:0:23436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.505679:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789048919.505724:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.505755:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.505829:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111515776 00000100:00100000:2.0:1789048919.505835:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111515776 00000100:00100000:2.0:1789048919.506261:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789048919.506273:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+16:23436:x1875953111515776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048919.506289:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048919.506306:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087779d0 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.506365:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087779d0 expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.506376:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087779d0 expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.506386:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1200, rc 0) 00000100:00100000:2.0:1789048919.506424:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111515776:12345-0@lo:101:mount.lustre.0 Request processed in 154us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.506431:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048919.506555:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048919.506571:0:23436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.506592:0:23436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048919.508689:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1789048919.509066:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048919.509623:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789048919.509653:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1789048919.509666:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1789048919.509678:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1789048919.509691:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1789048919.509706:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1789048919.509719:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1789048919.509731:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1789048919.509744:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789048919.509757:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1789048919.509770:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1789048919.509788:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1789048919.509794:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1789048919.509915:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048919.509997:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.511067:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.511166:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111515904 00000100:00100000:0.0:1789048919.511175:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111515904 00000100:00100000:0.0:1789048919.511221:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789048919.511231:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111515904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048919.511410:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111515904:12345-0@lo:501:mount.lustre.0 Request processed in 180us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.511418:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789048919.511697:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111515904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048919.511745:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048919.511794:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.511824:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e540 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.511893:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516032 00000100:00100000:0.0:1789048919.511899:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516032 00000100:00100000:0.0:1789048919.511921:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789048919.511928:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048919.512016:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516032:12345-0@lo:503:mount.lustre.0 Request processed in 88us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.512033:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048919.512365:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516032:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789048919.512796:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048919.512892:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048919.512937:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.512961:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.513367:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516160 00000100:00100000:0.0:1789048919.513374:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516160 00000100:00100000:0.0:1789048919.513401:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048919.513408:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048919.513516:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516160:12345-0@lo:502:mount.lustre.0 Request processed in 107us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.513525:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789048919.513726:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048919.513990:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789048919.514635:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1789048919.514662:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1789048919.514678:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1789048919.514692:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1789048919.514705:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1789048919.514717:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1789048919.514730:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1789048919.514744:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789048919.514758:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1789048919.514770:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1789048919.514808:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048919.514867:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.514918:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048919.515039:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516288 00000100:00100000:1.0:1789048919.515047:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516288 00000100:00100000:1.0:1789048919.515229:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789048919.515240:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048919.515376:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516288:12345-0@lo:502:mount.lustre.0 Request processed in 138us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048919.515383:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789048919.515492:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048919.515541:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1789048919.515550:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789048919.522188:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048919.522205:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522208:0:23449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789048919.522218:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c3fcc0000 00000020:00000080:3.0:1789048919.522221:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048919.522229:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048919.522231:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522233:0:23449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789048919.522249:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048919.522252:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522254:0:23449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789048919.522258:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c3fcc0000 00000020:00000080:3.0:1789048919.522260:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048919.522353:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048919.522357:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522359:0:23449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789048919.522361:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048919.522363:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522365:0:23449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048919.522369:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c3fcc0000 00000020:00000080:3.0:1789048919.522371:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048919.522389:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048919.522393:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522394:0:23449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789048919.522396:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789048919.522398:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522400:0:23449:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789048919.522403:0:23449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c3fcc0000 00000020:00000080:3.0:1789048919.522405:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789048919.522428:0:23449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789048919.522431:0:23449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048919.522432:0:23449:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789048919.522435:0:23449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1789048919.522731:0:23436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789048919.522767:0:23436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048919.522796:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.522810:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048919.522867:0:23436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789048919.522870:0:23436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c3fcc0000 10000000:01000000:2.0:1789048919.522885:0:23436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c3fcc0000 10000000:01000000:2.0:1789048919.522890:0:23436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789048919.522896:0:23436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c3fcc0000 from 1 10000000:01000000:2.0:1789048919.522899:0:23436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789048919.522935:0:23436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.522944:0:23436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.522966:0:23436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048919.522995:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789048919.523076:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048919.523134:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b081606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.523376:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516416 00000100:00100000:3.0:1789048919.523383:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516416 00000100:00100000:3.0:1789048919.523430:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789048919.523440:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:23436:x1875953111516416:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048919.523457:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048919.523471:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3d000/0x133f221c087779e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c087779de expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.523507:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3d000/0x133f221c087779e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c087779de expref: 18 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.523518:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3d000/0x133f221c087779e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087779de expref: 18 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.523528:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3d000, rc 0) 00000100:00100000:3.0:1789048919.523570:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516416:12345-0@lo:101:mount.lustre.0 Request processed in 132us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.523576:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789048919.527540:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048919.527571:0:23436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779e5 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.527585:0:23436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c087779e5 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048919.542680:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1789048919.544473:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048919.544740:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1789048919.544769:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1789048919.544783:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1789048919.544797:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1789048919.544809:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1789048919.544850:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1789048919.544868:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1789048919.549588:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1789048919.549653:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1789048919.549670:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1789048919.549684:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1789048919.549700:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1789048919.549714:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1789048919.549727:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1789048919.549742:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1789048919.549756:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1789048919.549770:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1789048919.549799:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1789048919.549813:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1789048919.549828:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1789048919.549843:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1789048919.555154:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1789048919.555217:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1789048919.555235:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1789048919.555257:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1789048919.555272:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1789048919.555285:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1789048919.555298:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1789048919.555311:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1789048919.555324:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1789048919.555358:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1789048919.555373:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1789048919.555385:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1789048919.555397:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1789048919.555410:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1789048919.555425:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1789048919.555441:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1789048919.555475:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1789048919.555493:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1789048919.555507:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1789048919.555522:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1789048919.555538:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1789048919.555554:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1789048919.555570:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1789048919.555585:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1789048919.555600:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1789048919.555616:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1789048919.555632:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1789048919.555805:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1789048919.555828:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1789048919.555859:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1789048919.555866:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1789048919.555977:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048919.556046:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.564665:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516544 00000100:00100000:3.0:1789048919.564681:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516544 00000100:00100000:3.0:1789048919.564769:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048919.564780:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048919.564944:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516544:12345-0@lo:501:mount.lustre.0 Request processed in 167us (8898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.564953:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789048919.565113:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.565150:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048919.565202:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048919.565256:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.565280:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516672 00000100:00100000:3.0:1789048919.565284:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516672 00000100:00100000:3.0:1789048919.565307:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048919.565314:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048919.565423:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516672:12345-0@lo:503:mount.lustre.0 Request processed in 109us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.565430:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789048919.565468:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.565481:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516672:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789048919.571356:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048919.573808:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048919.573908:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.573962:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.578117:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516800 00000100:00100000:2.0:1789048919.578260:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516800 00000100:00100000:2.0:1789048919.578362:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789048919.578373:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048919.578781:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516800:12345-0@lo:502:mount.lustre.0 Request processed in 408us (4871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.578790:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789048919.580749:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048919.581015:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1789048919.581068:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1789048919.581084:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1789048919.581099:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1789048919.581113:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1789048919.581126:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1789048919.582515:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1789048919.582582:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1789048919.582600:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1789048919.582616:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1789048919.582645:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1789048919.582662:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1789048919.582679:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1789048919.582694:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1789048919.582710:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1789048919.582754:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1789048919.582770:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1789048919.582784:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1789048919.582798:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1789048919.582814:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1789048919.582829:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1789048919.582844:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1789048919.582860:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1789048919.582878:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1789048919.582894:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1789048919.582907:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1789048919.582920:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1789048919.582933:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1789048919.582961:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1789048919.582978:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1789048919.582991:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1789048919.583019:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1789048919.583035:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1789048919.583050:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1789048919.583087:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1789048919.583103:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1789048919.583118:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1789048919.583131:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1789048919.583159:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1789048919.583174:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1789048919.583188:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1789048919.583202:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1789048919.583217:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1789048919.583232:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1789048919.583246:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1789048919.583260:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1789048919.583273:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1789048919.583302:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1789048919.583406:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048919.583487:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.583532:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.587047:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111516928 00000100:00100000:2.0:1789048919.587072:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111516928 00000100:00100000:2.0:1789048919.587171:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048919.587181:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048919.587395:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111516928:12345-0@lo:502:mount.lustre.0 Request processed in 216us (3907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.587413:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048919.588426:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e54000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111516928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048919.588711:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1789048919.588745:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1789048919.588787:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111517056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048919.588848:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048919.588886:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06980840 going to sleep for 11 seconds 00000100:00100000:2.0:1789048919.589481:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517056 00000100:00100000:2.0:1789048919.589489:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517056 00000100:00100000:2.0:1789048919.589542:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789048919.589552:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111517056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048919.589803:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111517056:12345-0@lo:502:mount.lustre.0 Request processed in 252us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.589811:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048919.610385:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111517056:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048919.610534:0:23436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1789048919.610559:0:23436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789048919.611750:0:23455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789048919.611771:0:23455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff959b077e99c0) 00000020:00000080:0.0:1789048919.611797:0:23455:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789048919.613522:0:23455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3fcc0000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789048919.613533:0:23455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c3fcc0000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789048919.613536:0:23455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3fcc0000 3 00010000:00080000:0.0:1789048919.613594:0:23455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c2088e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789048919.620218:0:23455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1789048919.620469:0:23455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789048919.620673:0:23455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789048919.620689:0:23455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x133f221c087779f3 00000100:00080000:2.0:1789048919.620699:0:23455:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789048919.620709:0:23455:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff959c2088e800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048919.620745:0:23455:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a2d80 x1875953111517184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048919.620778:0:23455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789048919.620804:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111517184:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789048919.620805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048919.620810:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048919.620812:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048919.620815:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789048919.620873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.622970:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517184 00000100:00100000:3.0:1789048919.622988:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517184 00000100:00100000:3.0:1789048919.623199:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048919.623209:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111517184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789048919.623248:0:22706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:3.0:1789048919.623291:0:22706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x133f221c087779fa 00000004:00100000:3.0:1789048919.623308:0:22706:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789048919.623368:0:22706:0:(import.c:65:import_set_state_nolock()) ffff959c2eff8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048919.623448:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875953111517184:12345-0@lo:38:llog_process_th.0 Request processed in 240us (2574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.623456:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789048919.623496:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959b080a2d80 x1875953111517184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048919.623507:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048919.623516:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789048919.623524:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789048919.623530:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789048919.623532:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c2088e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048919.623538:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875953111517184:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789048919.635287:0:23455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1789048919.635417:0:23436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789048919.635451:0:23436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048919.635473:0:23436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779e5 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.635509:0:23436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba0400/0x133f221c087779de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c087779e5 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789048919.635563:0:23436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789048919.635566:0:23436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048919.635567:0:23436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048919.635568:0:23436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048919.635570:0:23436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048919.635571:0:23436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048919.635572:0:23436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048919.635574:0:23436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048919.635575:0:23436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048919.635579:0:23436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1789048919.635581:0:23436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048919.635582:0:23436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789048919.635583:0:23436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048919.635585:0:23436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048919.635586:0:23436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048919.635587:0:23436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048919.635588:0:23436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789048919.635589:0:23436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048919.635591:0:23436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048919.635620:0:23436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789048919.635642:0:23436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111517312:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048919.635716:0:23436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048919.635759:0:23436:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b08160b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048919.639657:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517312 00000100:00100000:1.0:1789048919.639672:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517312 00000100:00100000:1.0:1789048919.639759:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789048919.639770:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:23436:x1875953111517312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048919.639804:0:22699:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789048919.639819:0:22699:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1789048919.645645:0:22684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789048919.646392:0:22699:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789048919.646403:0:22699:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789048919.646532:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789048919.646537:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789048919.646558:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.646579:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778fe expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.646587:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087779c2 expref: 18 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.646594:0:22720:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.646647:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087779c2 expref: 18 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.646661:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087779c2 expref: 18 pid: 22696 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.646677:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111517440:0@lo:104: 00000100:00100000:3.0:1789048919.646756:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048919.646814:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087778fe expref: 18 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.646823:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087778fe expref: 18 pid: 22699 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.646830:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111517568:0@lo:104: 00000100:00100000:3.0:1789048919.646851:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.646881:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b88240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.646901:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517440 00000100:00100000:3.0:1789048919.646908:0:22687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517440 00000100:00100000:3.0:1789048919.646942:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517568 00000100:00100000:3.0:1789048919.646944:0:22687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517568 00000100:00100000:3.0:1789048919.646956:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048919.646964:0:22687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+4:22720:x1875953111517440:12345-0@lo:104: 00010000:00010000:3.0:1789048919.646977:0:22687:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647036:0:22687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789048919.647042:0:22687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+4:22720:x1875953111517440:12345-0@lo:104: Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.647063:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789048919.647080:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048919.647086:0:22687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111517568:12345-0@lo:104: 00010000:00010000:3.0:1789048919.647093:0:22687:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647127:0:22687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789048919.647132:0:22687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111517568:12345-0@lo:104: Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.647270:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789048919.647287:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048919.647293:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647301:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048919.647305:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647314:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048919.647321:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048919.647327:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048919.647382:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647388:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048919.647416:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647422:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3ca00/0x133f221c087779c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087779c9 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647435:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048919.647438:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647443:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:3.0:1789048919.647446:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647453:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789048919.647460:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048919.647465:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789048919.647479:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647485:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789048919.647491:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647497:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef38e00/0x133f221c087778fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777905 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.647519:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048919.647521:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048919.647523:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048919.647536:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111517696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048919.647564:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.647592:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048919.647598:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111517824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048919.647618:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.647646:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517696 00000100:00100000:2.0:1789048919.647646:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517824 00000100:00100000:3.0:1789048919.647650:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517696 00000100:00100000:2.0:1789048919.647650:0:22690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517824 00010000:00010000:3.0:1789048919.647668:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087779c2 expref: 20 pid: 22696 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647668:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087778fe expref: 20 pid: 22699 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048919.647689:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048919.647702:0:22690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+20:3622:x1875953111517824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048919.647712:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048919.647717:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087778fe expref: 20 pid: 22699 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647726:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087778fe expref: 20 pid: 22699 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048919.647728:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048919.647741:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048919.647781:0:22690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+20:3622:x1875953111517824:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.647786:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048919.647803:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789048919.647810:0:22690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:3622:x1875953111517696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048919.647818:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048919.647822:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087779c2 expref: 19 pid: 22696 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647831:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087779c2 expref: 19 pid: 22696 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647842:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647851:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048919.647866:0:22690:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015656362s 00010000:00010000:2.0:1789048919.647940:0:22690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647955:0:22690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647962:0:22690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647967:0:22690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647972:0:22690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048919.647976:0:22690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647982:0:22690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.647991:0:22690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048919.648000:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048919.648025:0:22690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:3622:x1875953111517696:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048919.648031:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789048919.648625:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba0600/0x133f221c087779c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087779c2 expref: 18 pid: 22696 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.648637:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111517440:0@lo:104: 00010000:00010000:3.0:1789048919.648648:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1800/0x133f221c08777905 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087778fe expref: 17 pid: 22699 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048919.648656:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111517568:0@lo:104: 00010000:00010000:3.0:1789048919.648672:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.648680:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.648686:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048919.648699:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048919.648931:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+16:23436:x1875953111517312:12345-0@lo:253:mount.lustre.0 Request processed in 9162us (13213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048919.648940:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789048919.649021:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111517824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048919.649246:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111517696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048919.649947:0:23436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:23436:1875953111517312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789048919.649963:0:23436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789048919.649966:0:23436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048919.649968:0:23436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789048919.649969:0:23436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048919.649970:0:23436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048919.649971:0:23436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048919.649972:0:23436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048919.649974:0:23436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789048919.649975:0:23436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048919.649977:0:23436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789048919.649987:0:23436:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1789048919.661911:0:23436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1789048919.661926:0:23460:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1789048919.661930:0:23460:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789048919.663200:0:23461:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789048919.663251:0:23436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789048919.663646:0:23462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23462:1875953111517952:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789048919.663723:0:23462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048919.663754:0:23462:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aed7000 going to sleep for 11 seconds 00000040:01000000:1.0:1789048919.663909:0:23436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789048919.663945:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789048919.664414:0:23436:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789048919.664423:0:23436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789048919.664462:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048919.665422:0:23436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789048919.665870:0:23436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789048919.665897:0:23436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789048919.665999:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048919.666027:0:23461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789048919.666559:0:23436:0:(osd_handler.c:5577:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:3.0:1789048919.668274:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111517952 00000100:00100000:3.0:1789048919.668290:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111517952 00000100:00100000:3.0:1789048919.668386:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048919.668399:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23462:x1875953111517952:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.668550:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23462:x1875953111517952:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 154us (4827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.668558:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048919.668615:0:23462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23462:1875953111517952:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789048919.668654:0:23462:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789048919.668702:0:23462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23462:1875953111518080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.668748:0:23462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.668771:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518080 00000100:00100000:3.0:1789048919.668775:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518080 00000100:00100000:3.0:1789048919.668806:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048919.668812:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23462:x1875953111518080:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.668904:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23462:x1875953111518080:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.668911:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048919.668932:0:23462:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c4155b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048919.668944:0:23462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23462:1875953111518080:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.669005:0:23462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23462:1875953111518208:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.669030:0:23462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.669078:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518208 00000100:00100000:3.0:1789048919.669082:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518208 00000100:00100000:3.0:1789048919.669120:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048919.669127:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23462:x1875953111518208:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.669539:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23462:x1875953111518208:12345-0@lo:900:lod0001_rec0000.0 Request processed in 411us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048919.669546:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789048919.669564:0:23462:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f300 going to sleep for 11 seconds 00010000:00080000:3.0:1789048919.669579:0:23462:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff959c03e56300 x1875953111518208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048919.669590:0:23462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23462:1875953111518208:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.669629:0:23462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23462:1875953111518336:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789048919.669666:0:23462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048919.669688:0:23462:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789048919.669853:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518336 00000100:00100000:0.0:1789048919.669858:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518336 00000100:00100000:0.0:1789048919.669882:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048919.669888:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23462:x1875953111518336:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789048919.669946:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23462:x1875953111518336:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048919.669952:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789048919.670003:0:23462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23462:1875953111518336:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789048919.670064:0:23462:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048919.670458:0:23461:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789048919.670518:0:23461:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1789048919.679117:0:23462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789048919.679247:0:23462:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789048919.679253:0:23462:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1789048919.679847:0:23436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789048919.683222:0:23436:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789048919.683266:0:23436:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb770c555b988 00100000:10000000:0.0:1789048919.683276:0:23436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789048919.686216:0:23436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789048919.686264:0:23436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789048919.686288:0:23436:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789048919.686317:0:23436:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789048919.687110:0:23436:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048919.687408:0:23436:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789048919.720673:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048920.293657:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000040:00080000:3.0:1789048920.684705:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789048920.736787:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789048920.989467:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789048920.989475:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c3fcc0000 from 12 10000000:01000000:2.0:1789048920.989480:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789048920.989529:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048920.989542:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048920.989554:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048920.989580:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048920.989652:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048920.989709:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048920.989822:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518464 00000100:00100000:3.0:1789048920.989830:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518464 00000100:00100000:3.0:1789048920.989885:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789048920.989895:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+16:22701:x1875953111518464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048920.989909:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048920.989925:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a08 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048920.989952:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a08 expref: 17 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048920.989963:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a08 expref: 17 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048920.989972:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3de00, rc 0) 00000100:00100000:3.0:1789048920.990034:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111518464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048920.990073:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789048920.990319:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048920.990468:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048920.990477:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048920.990919:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048920.990962:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048920.991070:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048920.994181:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518592 00000100:00100000:2.0:1789048920.994198:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518592 00000100:00100000:2.0:1789048920.994268:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789048920.994278:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111518592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789048920.994306:0:22699:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789048920.994348:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789048920.994352:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789048920.994488:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111518592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 211us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048920.994495:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789048920.994682:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048920.994746:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048920.994758:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048920.994771:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048920.994784:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048920.994787:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c2e493000 from 12 10000000:01000000:1.0:1789048920.994791:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048920.994846:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048920.994856:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048920.994866:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048920.994888:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048920.994922:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048920.994961:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048920.995086:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518720 00000100:00100000:2.0:1789048920.995091:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518720 00000100:00100000:2.0:1789048920.995126:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789048920.995133:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111518720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048920.995151:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048920.995164:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a16 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048920.995187:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a16 expref: 18 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048920.995198:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a16 expref: 18 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048920.995207:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1400, rc 0) 00000100:00100000:2.0:1789048920.995504:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111518720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 370us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048920.995511:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789048920.996443:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048920.996465:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048920.996492:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048920.996552:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789048920.996595:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048920.996630:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b080bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048920.996808:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518848 00000100:00100000:2.0:1789048920.996815:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518848 00000100:00100000:2.0:1789048920.996850:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789048920.996858:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111518848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789048920.996874:0:22697:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789048920.996891:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789048920.996894:0:22697:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789048920.996980:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111518848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048920.996988:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789048920.997069:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111518848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789048920.997109:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789048920.997116:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048920.997126:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048921.309930:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000040:00080000:2.0:1789048921.701493:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789048921.758556:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048922.334947:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:2.0:1789048922.782320:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048923.364748:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00010000:00010000:0.0:1789048923.806587:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048924.381460:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 0 seconds 00000001:02000400:1.0:1789048924.521157:0:23704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789048924.640579:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111518976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048924.640662:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048924.640740:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111518976 00000100:00100000:2.0:1789048924.640749:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111518976 00000100:00100000:2.0:1789048924.640797:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048924.640805:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111518976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048924.640842:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048924.640892:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111518976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048924.640900:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048924.640954:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111518976:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789048924.650053:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789048924.650060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789048924.650064:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789048924.650105:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff959c05303000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789048924.650130:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b05d76680 x1875953111519232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789048924.650150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048924.650153:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048924.650155:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048924.650158:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048924.650189:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111519232:0@lo:38:kworker.0 00000100:00100000:0.0:1789048924.650252:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048924.650445:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111519104:0@lo:400:kworker.0 00000100:00100000:3.0:1789048924.650482:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048924.650523:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519104 00000100:00100000:3.0:1789048924.650530:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519104 00000100:00100000:3.0:1789048924.650570:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789048924.650579:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:3621:x1875953111519104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048924.650629:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:3621:x1875953111519104:12345-0@lo:400:kworker.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048924.650636:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789048924.650683:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111519104:0@lo:400:kworker.0 00000100:00080000:0.0:1789048924.650793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048924.650797:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048924.650799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048924.650801:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048924.650815:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111519360:0@lo:400:kworker.0 00000100:00100000:0.0:1789048924.650850:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048924.650908:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111519488:0@lo:400:kworker.0 00000100:00100000:0.0:1789048924.650940:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048924.650972:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519360 00000100:00100000:0.0:1789048924.650977:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519360 00000100:00100000:0.0:1789048924.651003:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519488 00000100:00100000:0.0:1789048924.651017:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519488 00000100:00100000:0.0:1789048924.651033:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048924.651040:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111519360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048924.651076:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111519360:12345-0@lo:400:kworker.0 Request processed in 37us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048924.651083:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789048924.651096:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048924.651103:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111519488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048924.651134:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111519488:12345-0@lo:400:kworker.0 Request processed in 31us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048924.651139:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789048924.651167:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d75c00 x1875953111519360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048924.651178:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111519360:0@lo:400:kworker.0 00010000:00080000:0.0:1789048924.651197:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d76300 x1875953111519488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048924.651205:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111519488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048924.651441:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519232 00000100:00100000:2.0:1789048924.651446:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519232 00000100:00100000:2.0:1789048924.651474:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048924.651479:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3619:x1875953111519232:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789048924.651503:0:22709:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 679 last 0 00000020:00000080:2.0:1789048924.651539:0:22709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08777a24 00000004:00100000:2.0:1789048924.651555:0:22709:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789048924.651560:0:22709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1789048924.673876:0:22709:0:(import.c:65:import_set_state_nolock()) ffff959c32351800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048924.673990:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111519232:12345-0@lo:38:kworker.0 Request processed in 22507us (23735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048924.674002:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789048924.674555:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789048924.674565:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2408010450010a0 00000100:00080000:1.0:1789048924.674572:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789048924.674575:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c05303000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789048924.674589:0:3619:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004603b0a0): req@ffff959b080a1f80 x1875953111512192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048924.674610:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111519232:0@lo:38:kworker.0 00000100:00100000:2.0:1789048924.674960:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048924.674990:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18e9f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789048924.675019:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111512192 00000100:00100000:2.0:1789048924.675033:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111512192 00000100:00100000:3.0:1789048924.675520:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111519616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048924.675554:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048924.675763:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519616 00000100:00100000:2.0:1789048924.675768:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519616 00000100:00100000:2.0:1789048924.675789:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048924.675797:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22745:x1875953111512192:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789048924.675887:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22745:x1875953111512192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048924.675894:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048924.675911:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048924.675918:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111519616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048924.675940:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048924.675984:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3620:x1875953111519616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048924.675990:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048924.676551:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22745:1875953111512192:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789048924.676588:0:22745:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789048924.676622:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22745:1875953111519744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789048924.676658:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048924.676690:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c03198000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048924.676773:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111519616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048924.677154:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519744 00000100:00100000:2.0:1789048924.677160:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519744 00000100:00100000:2.0:1789048924.677200:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048924.677207:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22745:x1875953111519744:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789048924.677822:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22745:x1875953111519744:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 614us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048924.677831:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789048924.677898:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c03e57480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22745:1875953111519744:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048924.677983:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22745:1875953111519872:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048924.678026:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048924.678264:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111519872 00000100:00100000:2.0:1789048924.678269:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111519872 00000100:00100000:2.0:1789048924.678305:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048924.678313:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22745:x1875953111519872:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789048924.678485:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048924.679269:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22745:x1875953111519872:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 953us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048924.679289:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789048924.679588:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22745:1875953111519872:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1789048924.679653:0:22745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048924.685782:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789048924.685866:0:22745:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1789048924.685872:0:22745:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789048924.831465:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789048925.505678:0:23757:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048925.506605:0:23757:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048925.853586:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048926.365848:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789048926.415264:0:23807:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048926.420803:0:23807:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048926.881461:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789048927.848042:0:23855:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd9735e80 20000000:00000080:1.0:1789048927.848060:0:23855:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959c07609000 uarg=0000000000000000 20000000:01000000:1.0:1789048927.848102:0:23855:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789048927.848109:0:23855:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789048927.848114:0:23855:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789048927.848905:0:23856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789048927.849136:0:23855:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789048927.856308:0:23855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789048927.856627:0:23855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.856646:0:23855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087778cd expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.856654:0:23855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c087779d0 expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.856662:0:23855:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.856707:0:23855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087779d0 expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.856723:0:23855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087779d0 expref: 17 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048927.856752:0:23855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23855:1875953111520000:0@lo:104: 00000100:00100000:3.0:1789048927.856823:0:23855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048927.856879:0:23855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c087778cd expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.856888:0:23855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c087778cd expref: 17 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048927.856896:0:23855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23855:1875953111520128:0@lo:104: 00000100:00100000:3.0:1789048927.856917:0:23855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048927.856940:0:23855:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c012543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048927.857033:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520000 00000100:00100000:1.0:1789048927.857042:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520000 00000100:00100000:1.0:1789048927.857081:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520128 00000100:00100000:1.0:1789048927.857084:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520128 00000100:00100000:1.0:1789048927.857100:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048927.857109:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+4:23855:x1875953111520000:12345-0@lo:104: 00010000:00010000:1.0:1789048927.857121:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048927.857319:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789048927.857326:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+4:23855:x1875953111520000:12345-0@lo:104: Request processed in 218us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048927.857367:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048927.857386:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048927.857393:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:23855:x1875953111520128:12345-0@lo:104: 00010000:00010000:1.0:1789048927.857402:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048927.857435:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789048927.857446:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:23855:x1875953111520128:12345-0@lo:104: Request processed in 54us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048927.857452:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789048927.857576:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048927.857584:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857592:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048927.857596:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857605:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048927.857611:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048927.857617:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789048927.857660:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857665:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048927.857689:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857695:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3c800/0x133f221c087779d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087779d7 expref: -99 pid: 23436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857707:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048927.857709:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857714:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061c00 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048927.857723:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857730:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048927.857737:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048927.857741:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789048927.857756:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857762:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048927.857778:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857785:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07061c00/0x133f221c087778cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c087778d4 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.857799:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048927.857801:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048927.857802:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048927.857809:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048927.857822:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111520256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048927.857857:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048927.857893:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111520384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048927.857915:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048927.857949:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520256 00000100:00100000:0.0:1789048927.857953:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520256 00010000:00010000:0.0:1789048927.858108:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087779d0 expref: 18 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048927.858132:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520384 00000100:00100000:0.0:1789048927.858136:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520384 00010000:00010000:0.0:1789048927.858149:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087778cd expref: 19 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048927.858160:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048927.858166:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:3621:x1875953111520256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048927.858177:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048927.858182:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087779d0 expref: 19 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858191:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087779d0 expref: 19 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858207:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048927.858236:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:3621:x1875953111520256:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048927.858242:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789048927.858257:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048927.858262:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:3622:x1875953111520384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048927.858270:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048927.858274:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c087778cd expref: 18 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858283:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c087778cd expref: 18 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858305:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858314:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858328:0:22691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858427:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858436:0:22691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858442:0:22691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858447:0:22691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3ca00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048927.858450:0:22691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858457:0:22691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858465:0:22691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.858474:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048927.858505:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:3622:x1875953111520384:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048927.858519:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048927.858557:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111520384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048927.858583:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111520256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048927.860233:0:23855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1200/0x133f221c087779d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087779d0 expref: 17 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048927.860251:0:23855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23855:1875953111520000:0@lo:104: 00010000:00010000:3.0:1789048927.860263:0:23855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061000/0x133f221c087778d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c087778cd expref: 16 pid: 22696 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048927.860271:0:23855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23855:1875953111520128:0@lo:104: 00010000:00010000:3.0:1789048927.860294:0:23855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.860304:0:23855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.860311:0:23855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048927.860922:0:23855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a2b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048927.909761:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048928.935572:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048928.993707:0:22701:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789048928.993715:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3fcc0000 from 13 10000000:01000000:1.0:1789048928.993720:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789048928.993766:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048928.993778:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048928.993790:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048928.993815:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048928.993886:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048928.993925:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048928.993946:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520512 00000100:00100000:1.0:1789048928.993952:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520512 00000100:00100000:1.0:1789048928.994009:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048928.994019:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+16:22701:x1875953111520512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048928.994032:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048928.994047:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a32 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048928.994072:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a32 expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048928.994082:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a32 expref: 17 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048928.994100:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061c00, rc 0) 00000100:00100000:1.0:1789048928.994138:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111520512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048928.994145:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048928.994202:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048928.994217:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048928.994226:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048928.994285:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048928.994311:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048928.994327:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048928.994360:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520640 00000100:00100000:1.0:1789048928.994363:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520640 00000100:00100000:1.0:1789048928.994387:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048928.994393:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111520640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048928.994520:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111520640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048928.994527:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048928.994558:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048928.994588:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048928.994626:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048928.994646:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3ef3e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048928.994657:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520768 00000100:00100000:1.0:1789048928.994660:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520768 00000100:00100000:1.0:1789048928.994680:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789048928.994688:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111520768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048928.994764:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111520768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048928.994770:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789048928.994809:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789048928.998137:0:23912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789048929.001655:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789048929.001697:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048929.001710:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048929.001723:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048929.001735:0:22701:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048929.001737:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c2e493000 from 13 10000000:01000000:3.0:1789048929.001740:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048929.001778:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048929.001786:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048929.001796:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048929.001819:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048929.001885:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048929.002632:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976900 going to sleep for 11 seconds 00000100:00100000:1.0:1789048929.006249:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111520896 00000100:00100000:1.0:1789048929.006268:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111520896 00000100:00100000:1.0:1789048929.006651:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789048929.006664:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+17:22701:x1875953111520896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048929.006683:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048929.006706:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a40 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048929.006737:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a40 expref: 18 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048929.006748:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a40 expref: 18 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048929.006756:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060c00, rc 0) 00000100:00100000:1.0:1789048929.006853:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111520896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (4967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048929.006860:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789048929.006956:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111520896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048929.006987:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048929.007005:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048929.007095:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111521024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048929.007132:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048929.015107:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521024 00000100:00100000:0.0:1789048929.015124:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521024 00000100:00100000:0.0:1789048929.015184:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048929.015194:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111521024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048929.015630:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111521024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 437us (8496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048929.015639:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789048929.017426:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976900 going to sleep for 11 seconds 00000100:00100000:3.0:1789048929.017476:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111521024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048929.017731:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111521152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048929.017801:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048929.017831:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976900 going to sleep for 11 seconds 00000100:00100000:0.0:1789048929.018477:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521152 00000100:00100000:0.0:1789048929.018486:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521152 00000100:00100000:0.0:1789048929.018548:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048929.018558:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111521152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048929.018683:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:22701:x1875953111521152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048929.018690:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789048929.018924:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111521152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789048929.021125:0:23915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789048929.026141:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789048929.026184:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048929.026195:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048929.026208:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048929.764487:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111521280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048929.764571:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048929.764651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048929.764655:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048929.764658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048929.764668:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048929.764689:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048929.764693:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048929.764695:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048929.764698:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048929.764720:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111521408:0@lo:400:kworker.0 00000100:00100000:0.0:1789048929.764753:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048929.764781:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789048929.764787:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111521536:0@lo:400:kworker.0 00000100:00100000:0.0:1789048929.764811:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048929.764836:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111521664:0@lo:400:kworker.0 00000100:00100000:0.0:1789048929.764876:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048929.764895:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048929.764899:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111521792:0@lo:400:kworker.0 00000100:00100000:0.0:1789048929.764940:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048929.764984:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521536 00000100:00100000:0.0:1789048929.764991:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521536 00000100:00100000:0.0:1789048929.765110:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521792 00000100:00100000:0.0:1789048929.765114:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521792 00000100:00100000:0.0:1789048929.765130:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048929.765138:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111521536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048929.765187:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111521536:12345-0@lo:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048929.765194:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048929.765211:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048929.765224:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111521792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048929.765259:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111521792:12345-0@lo:400:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048929.765265:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789048929.765301:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d74e00 x1875953111521536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048929.765315:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111521536:0@lo:400:kworker.0 00010000:00080000:0.0:1789048929.765369:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b05d76680 x1875953111521792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048929.765377:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111521792:0@lo:400:kworker.0 00000100:00100000:2.0:1789048929.765478:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521280 00000100:00100000:2.0:1789048929.765483:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521280 00000100:00100000:2.0:1789048929.765505:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521664 00000100:00100000:2.0:1789048929.765508:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521664 00000100:00100000:2.0:1789048929.765519:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048929.765525:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111521280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048929.765550:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048929.765591:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111521280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048929.765596:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048929.765609:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048929.765614:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048929.765644:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111521664:12345-0@lo:400:kworker.0 Request processed in 29us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048929.765649:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789048929.765668:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048919/real 1789048919] req@ffff959b05d77480 x1875953111515392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765683:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b05d77480 x1875953111515392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765693:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048919/real 1789048919] req@ffff959c3fcd0000 x1875953111515264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765703:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959c3fcd0000 x1875953111515264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765720:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048914/real 1789048914] req@ffff959b080a2300 x1875953111513216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765733:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080a2300 x1875953111513216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765741:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048914/real 1789048914] req@ffff959b080a1c00 x1875953111513344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048929.765752:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080a1c00 x1875953111513344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048929 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048929.765764:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048929.765778:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048929.765781:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111515392:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789048929.765785:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048929.765790:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048929.765792:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111515264:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789048929.765797:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048929.765802:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048929.765804:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111513216:0@lo:8:kworker.0 00000100:00080000:2.0:1789048929.765808:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048929.765811:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048929.765813:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111513344:0@lo:8:kworker.0 00000100:00100000:2.0:1789048929.765854:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111521280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048929.765887:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111521664:0@lo:400:kworker.0 00000100:00080000:2.0:1789048929.765902:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048929.765906:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789048929.765908:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048929.765912:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1789048929.765916:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048929.765923:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959b07589000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048929.765946:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a1c00 x1875953111521920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048929.765970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048929.765973:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048929.765975:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048929.765978:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 669 00000100:00080000:2.0:1789048929.765981:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789048929.765985:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048929.765996:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a2300 x1875953111522048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789048929.766122:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111522176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048929.766148:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789048929.766529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048929.766532:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789048929.766534:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048929.766536:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1789048929.766539:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789048929.766543:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959b06839800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048929.766554:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a3b80 x1875953111522304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048929.766564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048929.766566:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048929.766567:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048929.766569:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 674 00000100:00080000:2.0:1789048929.766571:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789048929.766574:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048929.766580:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a2680 x1875953111522432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048929.766595:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111521920:0@lo:8:kworker.0 00000400:00000100:2.0:1789048929.766615:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111521920 offset 0 length 520: 4 00000100:00100000:2.0:1789048929.766624:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111522048:0@lo:8:kworker.0 00000400:00000100:2.0:1789048929.766635:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111522048 offset 0 length 520: 4 00000100:00100000:2.0:1789048929.766640:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111522304:0@lo:8:kworker.0 00000400:00000100:2.0:1789048929.766655:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111522304 offset 0 length 520: 4 00000100:00100000:2.0:1789048929.766664:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111522432:0@lo:8:kworker.0 00000400:00000100:2.0:1789048929.766679:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875953111522432 offset 0 length 520: 4 00000100:00100000:2.0:1789048929.766698:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111522176 00000100:00100000:2.0:1789048929.766703:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111522176 00000100:00100000:2.0:1789048929.766725:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048929.766731:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111522176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048929.766752:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048929.770111:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111522176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3370us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048929.770130:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789048929.771720:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111521408 00000100:00100000:2.0:1789048929.771736:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111521408 00000100:00100000:2.0:1789048929.771798:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789048929.771807:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:3620:x1875953111521408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048929.771897:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+18:3620:x1875953111521408:12345-0@lo:400:kworker.0 Request processed in 90us (7142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048929.771904:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789048929.772641:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111522176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048929.772657:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111521408:0@lo:400:kworker.0 00010000:00010000:1.0:1789048929.952172:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789048930.295024:0:23437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789048930.974715:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789048931.934855:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789048932.001512:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048933.021594:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048934.045588:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789048934.461743:0:24204:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789048934.461747:0:24204:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789048934.461749:0:24204:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789048934.461851:0:24204:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c414c6800 00000020:01000004:3.0:1789048934.461866:0:24204:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789048934.461879:0:24204:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789048934.461898:0:24204:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff959c2a4219c0) 00000020:00000080:3.0:1789048934.461926:0:24204:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789048934.534209:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789048934.537012:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789048934.537432:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789048934.537653:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789048934.537828:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789048934.538056:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789048934.538272:0:24204:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1789048934.539093:0:24204:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789048934.539308:0:24204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789048934.539321:0:24204:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789048934.539513:0:24204:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x133f221c08777a55 00000020:01000004:1.0:1789048934.539522:0:24204:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789048934.539546:0:24204:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789048934.539549:0:24204:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789048934.539556:0:24204:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789048934.539561:0:24204:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789048934.539572:0:24204:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff959c20a04d40) 00000020:00000080:1.0:1789048934.539583:0:24204:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789048934.540719:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789048934.540881:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789048934.540888:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789048934.544933:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789048934.544945:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789048934.545365:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789048934.545372:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789048934.546760:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048934.547444:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789048934.547453:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789048934.551725:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789048934.551741:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789048934.583977:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048934.584228:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789048934.584235:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789048934.590322:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789048934.590526:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789048934.591718:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789048934.591728:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789048934.594207:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789048934.594523:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789048934.594531:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789048934.595532:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789048934.595543:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789048934.660156:0:24204:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789048934.660392:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789048934.660400:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789048934.661436:0:24204:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789048934.661446:0:24204:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789048934.662115:0:24204:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789048934.662146:0:24204:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789048934.662153:0:24204:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789048934.682982:0:24204:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789048934.683027:0:24204:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789048934.683032:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789048934.683034:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789048934.683035:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048934.683037:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048934.683038:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048934.683039:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048934.683041:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048934.683043:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048934.683044:0:24204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789048934.683048:0:24204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789048934.683050:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789048934.683051:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789048934.683052:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048934.683053:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048934.683055:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048934.683056:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048934.683057:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048934.683058:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048934.683059:0:24204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789048934.683093:0:24204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789048934.683113:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522560:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789048934.683182:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.683239:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c14f4ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.683366:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111522560 00000100:00100000:3.0:1789048934.683374:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111522560 00000100:00100000:3.0:1789048934.683430:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789048934.683440:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:24204:x1875953111522560:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048934.683471:0:22697:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789048934.683474:0:22697:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789048934.683478:0:22697:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789048934.683972:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:24204:x1875953111522560:12345-0@lo:253:mount.lustre.0 Request processed in 532us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.683981:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789048934.684160:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789048934.684171:0:24204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789048934.684174:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789048934.684176:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789048934.684326:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789048934.684329:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789048934.684330:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789048934.684349:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789048934.684351:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789048934.684353:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789048934.684354:0:24204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789048934.684376:0:24204:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c414c6800 from lustre-OST0000 10000000:01000000:1.0:1789048934.684409:0:24204:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789048934.684425:0:24204:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789048934.684434:0:24204:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c394b99c0 local copy 00010000:00010000:1.0:1789048934.684446:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048934.684537:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048934.684570:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.684608:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c14f4e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.684663:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111522688 00000100:00100000:2.0:1789048934.684669:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111522688 00000100:00100000:2.0:1789048934.684713:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789048934.684723:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c19ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:24204:x1875953111522688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048934.684811:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c19ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+18:24204:x1875953111522688:12345-0@lo:501:mount.lustre.0 Request processed in 90us (239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048934.684819:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789048934.685845:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522688:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789048934.685865:0:24204:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789048934.685891:0:24204:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789048934.685898:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.685921:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048934.685949:0:24204:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c414c6800 10000000:01000000:1.0:1789048934.685966:0:24204:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789048934.685972:0:24204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789048934.685975:0:24204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048934.685980:0:24204:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789048934.685983:0:24204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789048934.686010:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.686018:0:24204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.686042:0:24204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048934.686058:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048934.686098:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.686133:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c14f4e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.686299:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111522816 00000100:00100000:3.0:1789048934.686306:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111522816 00000100:00100000:3.0:1789048934.686378:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048934.686387:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+18:24204:x1875953111522816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048934.686400:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048934.686414:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a63 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.686437:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a63 expref: 19 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.686448:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3ca00/0x133f221c08777a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a63 expref: 19 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.686457:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ca00, rc 0) 00000100:00100000:3.0:1789048934.686497:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111522816:12345-0@lo:101:mount.lustre.0 Request processed in 111us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.686514:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789048934.687929:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048934.687963:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a6a expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.687974:0:24204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a6a expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048934.690152:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1789048934.691430:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789048934.696192:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789048934.698794:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789048934.698837:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789048934.698859:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789048934.698877:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789048934.698892:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789048934.698920:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789048934.699420:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789048934.699448:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1789048934.699466:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1789048934.699481:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1789048934.699498:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1789048934.699527:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1789048934.699534:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1789048934.699641:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048934.699709:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.699753:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c029ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.699945:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111522944 00000100:00100000:2.0:1789048934.699953:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111522944 00000100:00100000:2.0:1789048934.700027:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789048934.700036:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111522944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048934.700189:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111522944:12345-0@lo:501:mount.lustre.0 Request processed in 154us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.700198:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789048934.700420:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111522944:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048934.700458:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048934.700505:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.700537:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.700674:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523072 00000100:00100000:3.0:1789048934.700679:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523072 00000100:00100000:3.0:1789048934.700713:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789048934.700720:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523072:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048934.705370:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523072:12345-0@lo:503:mount.lustre.0 Request processed in 4640us (4854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.705385:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789048934.705513:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523072:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048934.706039:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048934.706128:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523200:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048934.706181:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.706229:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.706365:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523200 00000100:00100000:2.0:1789048934.706379:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523200 00000100:00100000:2.0:1789048934.706423:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789048934.706432:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048934.707004:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523200:12345-0@lo:502:mount.lustre.0 Request processed in 571us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.707014:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789048934.707575:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048934.707821:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789048934.707853:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789048934.707867:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789048934.707881:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789048934.707897:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789048934.707922:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789048934.707972:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789048934.707990:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789048934.708016:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1789048934.708031:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1789048934.708043:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1789048934.708056:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1789048934.708087:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523328:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048934.708140:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.708183:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.708601:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523328 00000100:00100000:3.0:1789048934.708609:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523328 00000100:00100000:3.0:1789048934.708655:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789048934.708664:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.708791:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523328:12345-0@lo:502:mount.lustre.0 Request processed in 127us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.708798:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789048934.708916:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048934.708986:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1789048934.709006:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789048934.709883:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789048934.709893:0:24221:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789048934.709918:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789048934.709921:0:24221:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789048934.709927:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789048934.709942:0:24221:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff959c2a420000) 00000020:00000080:3.0:1789048934.709976:0:24221:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789048934.709983:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789048934.710057:0:24221:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c414c6800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789048934.710066:0:24221:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789048934.710073:0:24221:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x133f221c08777a78 00010000:00010000:3.0:1789048934.723739:0:24221:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789048934.724656:0:24221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1789048934.727323:0:24221:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789048934.739220:0:24221:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789048934.739230:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048934.739236:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048934.739238:0:24221:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789048934.739241:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789048934.739244:0:24221:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789048934.739245:0:24221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048934.739247:0:24221:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789048934.739248:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789048934.739250:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048934.739251:0:24221:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789048934.739253:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048934.739255:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048934.739257:0:24221:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789048934.739259:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789048934.739261:0:24221:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789048934.739263:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048934.739265:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048934.739267:0:24221:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789048934.739269:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048934.739271:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048934.739272:0:24221:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789048934.739275:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789048934.739305:0:24221:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048934.739307:0:24221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048934.739308:0:24221:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789048934.739311:0:24221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789048934.739564:0:24204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789048934.739590:0:24204:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789048934.739612:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a6a expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048934.739625:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061400/0x133f221c08777a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a6a expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048934.739633:0:24204:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c6800 from 1 10000000:01000000:0.0:1789048934.739635:0:24204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048934.739667:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048934.739675:0:24204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048934.739686:0:24204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048934.739709:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048934.739766:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.739805:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891000 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.739982:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523456 00000100:00100000:2.0:1789048934.739989:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523456 00000100:00100000:2.0:1789048934.740145:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789048934.740154:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+19:24204:x1875953111523456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048934.740165:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048934.740177:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a7f expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.740198:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a7f expref: 20 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.740208:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a7f expref: 20 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.740215:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1800, rc 0) 00000100:00100000:2.0:1789048934.740246:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523456:12345-0@lo:101:mount.lustre.0 Request processed in 94us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.740252:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789048934.740328:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048934.740369:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048934.740378:0:24204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048934.741440:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789048934.741682:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048934.741861:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789048934.741889:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789048934.741904:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789048934.741932:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789048934.741945:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789048934.742298:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789048934.742319:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789048934.742423:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789048934.742441:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789048934.742455:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789048934.742469:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789048934.742486:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789048934.742491:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789048934.742570:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048934.742631:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.742721:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891780 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.747228:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523584 00000100:00100000:2.0:1789048934.747243:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523584 00000100:00100000:2.0:1789048934.747306:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789048934.747316:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048934.747510:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523584:12345-0@lo:501:mount.lustre.0 Request processed in 195us (4878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.747518:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789048934.747654:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048934.747710:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048934.747766:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.747805:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69780 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.747849:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523712 00000100:00100000:3.0:1789048934.747854:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523712 00000100:00100000:3.0:1789048934.747888:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048934.747896:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048934.748006:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523712:12345-0@lo:503:mount.lustre.0 Request processed in 110us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.748013:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789048934.748133:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523712:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789048934.748568:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789048934.748645:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048934.748682:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.750346:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69780 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.756321:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523840 00000100:00100000:3.0:1789048934.756361:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523840 00000100:00100000:3.0:1789048934.756429:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789048934.756440:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.756615:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523840:12345-0@lo:502:mount.lustre.0 Request processed in 175us (7930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.756622:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789048934.756793:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048934.757068:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789048934.757102:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1789048934.757119:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1789048934.757134:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1789048934.757149:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1789048934.757163:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1789048934.757178:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1789048934.757192:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1789048934.757207:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1789048934.757221:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1789048934.757235:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1789048934.757282:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048934.757326:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.757373:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb69780 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.757626:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111523968 00000100:00100000:3.0:1789048934.757632:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111523968 00000100:00100000:3.0:1789048934.757672:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789048934.757689:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.757774:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111523968:12345-0@lo:502:mount.lustre.0 Request processed in 87us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.757783:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048934.758364:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111523968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048934.758428:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1789048934.758439:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789048934.764539:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048934.764551:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.764568:0:24225:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789048934.764575:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c414c6800 00000020:00000080:1.0:1789048934.764578:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048934.764588:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048934.764590:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.764592:0:24225:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789048934.764594:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048934.764596:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.764598:0:24225:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789048934.764601:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c414c6800 00000020:00000080:1.0:1789048934.764603:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048934.764702:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048934.764706:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.764707:0:24225:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789048934.764710:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048934.764712:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.764714:0:24225:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048934.764717:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c414c6800 00000020:00000080:1.0:1789048934.764719:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048934.771822:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048934.771861:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.771864:0:24225:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048934.771868:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048934.771872:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.771874:0:24225:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789048934.771886:0:24225:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c414c6800 00000020:00000080:1.0:1789048934.771889:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048934.771976:0:24225:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048934.771981:0:24225:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048934.771982:0:24225:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789048934.771986:0:24225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789048934.774667:0:24204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789048934.774714:0:24204:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048934.774745:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.774767:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048934.774827:0:24204:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789048934.774830:0:24204:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c414c6800 10000000:01000000:2.0:1789048934.774834:0:24204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c414c6800 10000000:01000000:2.0:1789048934.774837:0:24204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789048934.774844:0:24204:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c414c6800 from 1 10000000:01000000:2.0:1789048934.774847:0:24204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789048934.774882:0:24204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.774890:0:24204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.774901:0:24204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048934.774937:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789048934.781012:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.781099:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c414b0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.786170:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524096 00000100:00100000:3.0:1789048934.786186:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524096 00000100:00100000:3.0:1789048934.789008:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789048934.789028:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+20:24204:x1875953111524096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048934.789049:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048934.789070:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3ce00/0x133f221c08777a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777a8d expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.789099:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3ce00/0x133f221c08777a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777a8d expref: 21 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.789112:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3ce00/0x133f221c08777a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a8d expref: 21 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.789121:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3ce00, rc 0) 00000100:00100000:3.0:1789048934.789200:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524096:12345-0@lo:101:mount.lustre.0 Request processed in 180us (8195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.789207:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789048934.794041:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789048934.794071:0:24204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a94 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048934.794085:0:24204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777a94 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048934.801244:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789048934.801571:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789048934.801778:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789048934.801802:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789048934.801817:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789048934.801831:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789048934.801845:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789048934.801860:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789048934.801875:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789048934.801889:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789048934.801905:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789048934.801932:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789048934.801944:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789048934.801971:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789048934.801987:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789048934.802002:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789048934.802016:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789048934.802031:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789048934.802061:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789048934.802077:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789048934.802089:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789048934.802103:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789048934.802116:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789048934.802130:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789048934.802141:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789048934.802155:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789048934.802166:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789048934.802180:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789048934.802193:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789048934.802205:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789048934.802215:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789048934.802240:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789048934.802254:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789048934.802268:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789048934.802293:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789048934.802310:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789048934.802323:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789048934.802364:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789048934.802380:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789048934.802394:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789048934.802406:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789048934.802418:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789048934.802428:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789048934.802439:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789048934.802454:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789048934.802467:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789048934.802481:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789048934.802495:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789048934.802508:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789048934.802520:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789048934.802645:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789048934.802665:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789048934.802683:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789048934.802689:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789048934.802780:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048934.802850:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.802916:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524224 00000100:00100000:3.0:1789048934.802924:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524224 00000100:00100000:3.0:1789048934.802969:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048934.802978:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048934.803100:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524224:12345-0@lo:501:mount.lustre.0 Request processed in 122us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.803116:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789048934.803237:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c14f4e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.803260:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048934.803290:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524352:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048934.803325:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.803366:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524352 00000100:00100000:3.0:1789048934.803370:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524352 00000100:00100000:3.0:1789048934.803393:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048934.803398:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524352:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789048934.803465:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524352:12345-0@lo:503:mount.lustre.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.803472:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789048934.803504:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06b883c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.803517:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524352:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789048934.803881:0:24204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789048934.803946:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.803980:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.804004:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524480 00000100:00100000:3.0:1789048934.804009:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524480 00000100:00100000:3.0:1789048934.804033:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789048934.804039:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.804106:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524480:12345-0@lo:502:mount.lustre.0 Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.804113:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789048934.804148:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.804160:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048934.804298:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789048934.804321:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789048934.804360:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789048934.804377:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789048934.804391:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789048934.804402:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789048934.804416:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789048934.804430:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789048934.804446:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789048934.804460:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789048934.804491:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789048934.804508:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789048934.804521:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789048934.804533:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789048934.804548:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789048934.804561:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789048934.804576:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789048934.804591:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789048934.804605:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789048934.804619:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789048934.804634:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789048934.804648:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789048934.804661:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789048934.804676:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789048934.804689:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789048934.804702:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789048934.804732:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789048934.804749:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789048934.804764:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789048934.804780:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789048934.804806:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789048934.804820:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789048934.804833:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789048934.804845:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789048934.804858:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789048934.804871:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789048934.804885:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789048934.804898:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789048934.812754:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789048934.812791:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789048934.812807:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789048934.812820:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789048934.812851:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789048934.812867:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789048934.812883:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789048934.812895:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789048934.812920:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789048934.812936:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789048934.815042:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.815130:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.815218:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c0383f540 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.821455:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524608 00000100:00100000:2.0:1789048934.821470:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524608 00000100:00100000:2.0:1789048934.821535:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789048934.821545:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048934.821721:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524608:12345-0@lo:502:mount.lustre.0 Request processed in 177us (6591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.821729:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789048934.821882:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048934.822127:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789048934.822158:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789048934.822197:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048934.829363:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.829417:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c20891b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.829498:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524736 00000100:00100000:3.0:1789048934.829507:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524736 00000100:00100000:3.0:1789048934.829565:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789048934.829575:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789048934.830100:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111524736:12345-0@lo:502:mount.lustre.0 Request processed in 525us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.830109:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789048934.830172:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111524736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789048934.830279:0:24204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1789048934.830294:0:24204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789048934.833359:0:24231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789048934.833376:0:24231:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff959c394bb380) 00000020:00000080:2.0:1789048934.833400:0:24231:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789048934.833499:0:24231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c414c6800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789048934.833504:0:24231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c414c6800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789048934.833507:0:24231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c414c6800 3 00010000:00080000:2.0:1789048934.833547:0:24231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c3e9bc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789048934.836921:0:24231:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789048934.837303:0:24231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789048934.837376:0:24231:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789048934.837389:0:24231:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x133f221c08777aa2 00000100:00080000:3.0:1789048934.837399:0:24231:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048934.837411:0:24231:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff959c3e9bc800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048934.837449:0:24231:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c322cb480 x1875953111524864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048934.837499:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111524864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789048934.837565:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.837628:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524864 00000100:00100000:3.0:1789048934.837635:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524864 00000100:00100000:3.0:1789048934.837666:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048934.837673:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111524864:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789048934.839801:0:22706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1789048934.839852:0:22706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x133f221c08777aa9 00000004:00100000:3.0:1789048934.839869:0:22706:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789048934.839923:0:22706:0:(import.c:65:import_set_state_nolock()) ffff959c3c4a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048934.840025:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875953111524864:12345-0@lo:38:llog_process_th.0 Request processed in 2350us (2459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.840035:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789048934.840072:0:24231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00080000:2.0:1789048934.840401:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c322cb480 x1875953111524864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048934.840414:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048934.840423:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1789048934.840431:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789048934.840436:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789048934.840439:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9bc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789048934.840446:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3619:1875953111524864:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1789048934.840837:0:24231:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789048934.840854:0:24231:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff959c2a423380) 00000020:00000080:3.0:1789048934.840880:0:24231:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789048934.841042:0:24231:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c414c6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789048934.841046:0:24231:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c414c6800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789048934.841049:0:24231:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c414c6800 3 00010000:00080000:3.0:1789048934.841074:0:24231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b0833d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.116@tcp at head 00000100:00080000:2.0:1789048934.844094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048934.844100:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048934.844103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048934.844106:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048934.844149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048934.844152:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789048934.844154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048934.844157:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048934.844207:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111525120:0@lo:400:kworker.0 00000100:00100000:2.0:1789048934.844294:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.844353:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048934.844360:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111525248:0@lo:400:kworker.0 00000100:00100000:2.0:1789048934.844387:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.844425:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525248 00000100:00100000:2.0:1789048934.844432:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525248 00000100:00100000:2.0:1789048934.844474:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048934.844482:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111525248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048934.844533:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111525248:12345-0@lo:400:kworker.0 Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.844539:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789048934.844582:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111525248:0@lo:400:kworker.0 00000100:00100000:3.0:1789048934.845652:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525120 00000100:00100000:3.0:1789048934.845662:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525120 00000100:00100000:3.0:1789048934.845747:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048934.845756:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111525120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048934.845815:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111525120:12345-0@lo:400:kworker.0 Request processed in 60us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.845821:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789048934.845931:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111524992:0@lo:400:kworker.0 00000100:00100000:0.0:1789048934.845978:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.846021:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048934.846029:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111525376:0@lo:400:kworker.0 00000100:00100000:0.0:1789048934.846053:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048934.846689:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111524992 00000100:00100000:0.0:1789048934.846695:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111524992 00000100:00100000:0.0:1789048934.846732:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048934.846739:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111524992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048934.846782:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111524992:12345-0@lo:400:kworker.0 Request processed in 43us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048934.846788:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048934.846822:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111524992:0@lo:400:kworker.0 00000100:00100000:2.0:1789048934.853266:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525376 00000100:00100000:2.0:1789048934.853278:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525376 00000100:00100000:2.0:1789048934.853359:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048934.853371:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111525376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048934.853473:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111525376:12345-0@lo:400:kworker.0 Request processed in 104us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048934.853481:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789048934.853583:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b080a0e00 x1875953111525376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048934.853601:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111525376:0@lo:400:kworker.0 00010000:00080000:3.0:1789048934.853809:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959b080a0380 x1875953111525120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048934.853821:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111525120:0@lo:400:kworker.0 00010000:00010000:3.0:1789048934.856078:0:24231:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789048934.856372:0:24231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789048934.856421:0:24231:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789048934.856434:0:24231:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x133f221c08777ab7 00000100:00080000:3.0:1789048934.856444:0:24231:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789048934.856456:0:24231:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff959b0833d000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048934.856488:0:24231:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c322c8380 x1875953111525504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048934.856511:0:24231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789048934.856763:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111525504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789048934.856831:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048934.857077:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525504 00000100:00100000:3.0:1789048934.857084:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525504 00000100:00100000:3.0:1789048934.857123:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048934.857139:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1875953111525504:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789048934.857166:0:22706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1789048934.857207:0:22706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x133f221c08777abe 00000004:00100000:3.0:1789048934.857221:0:22706:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789048934.857252:0:22706:0:(import.c:65:import_set_state_nolock()) ffff959c3c4aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048934.857305:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875953111525504:12345-0@lo:38:llog_process_th.0 Request processed in 166us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048934.857312:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789048934.857377:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff959c322c8380 x1875953111525504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048934.857389:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048934.857397:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789048934.857404:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789048934.857409:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789048934.857412:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b0833d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048934.857417:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3619:1875953111525504:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789048934.857609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048934.857614:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048934.857624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048934.857627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048934.857631:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048934.857634:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048934.857637:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048934.857640:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789048934.857855:0:24231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789048934.858069:0:24204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789048934.858096:0:24204:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789048934.858122:0:24204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a94 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.858146:0:24204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba0600/0x133f221c08777a8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777a94 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789048934.858192:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789048934.858195:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789048934.858196:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048934.858198:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048934.858199:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048934.858200:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048934.858202:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048934.858204:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048934.858205:0:24204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048934.858209:0:24204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789048934.858211:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789048934.858213:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789048934.858214:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048934.858215:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048934.858216:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048934.858217:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048934.858219:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048934.858220:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048934.858221:0:24204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789048934.858238:0:24204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789048934.858252:0:24204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111525632:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048934.858294:0:24204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.858313:0:24204:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048934.858481:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525632 00000100:00100000:3.0:1789048934.858486:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525632 00000100:00100000:3.0:1789048934.858530:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789048934.858539:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111525632:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789048934.858561:0:22696:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789048934.858573:0:22696:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789048934.877653:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048934.877676:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111525760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048934.877748:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.877797:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525760 00000100:00100000:1.0:1789048934.877805:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525760 00000100:00100000:1.0:1789048934.877849:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048934.877859:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111525760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048934.877893:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789048934.877949:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111525760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048934.877967:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048934.878015:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111525760:0@lo:41:osp-pre-0-1.0 20000000:01000000:0.0:1789048934.878407:0:22696:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789048934.878420:0:22696:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789048934.878667:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:24204:x1875953111525632:12345-0@lo:253:mount.lustre.0 Request processed in 20128us (20370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048934.878677:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:2.0:1789048934.878746:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789048934.878751:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789048934.878771:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.878787:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.878816:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a16 expref: 20 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.878824:0:22720:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.878855:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777a16 expref: 20 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.878867:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777a16 expref: 20 pid: 22696 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048934.878879:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111525888:0@lo:104: 00000100:00100000:2.0:1789048934.878921:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789048934.878975:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.878983:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048934.878991:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111526016:0@lo:104: 00000100:00100000:2.0:1789048934.879015:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.879028:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048934.879057:0:24204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:24204:1875953111525632:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789048934.879067:0:24204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789048934.879071:0:24204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789048934.879072:0:24204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789048934.879074:0:24204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789048934.879081:0:24204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789048934.879083:0:24204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789048934.879084:0:24204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789048934.879085:0:24204:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789048934.879087:0:24204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789048934.879089:0:24204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789048934.879101:0:24204:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789048934.879862:0:22688:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789048934.879876:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111525888 00000100:00100000:0.0:1789048934.879882:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111525888 00000100:00100000:0.0:1789048934.879918:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526016 00000100:00100000:0.0:1789048934.879921:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526016 00000100:00100000:0.0:1789048934.879944:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048934.879951:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+4:22720:x1875953111525888:12345-0@lo:104: 00010000:00010000:0.0:1789048934.879975:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048934.880037:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789048934.880042:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+4:22720:x1875953111525888:12345-0@lo:104: Request processed in 92us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048934.880049:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789048934.880064:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789048934.880070:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c38605850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111526016:12345-0@lo:104: 00010000:00010000:0.0:1789048934.880078:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048934.880108:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789048934.880113:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c38605850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111526016:12345-0@lo:104: Request processed in 44us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048934.880119:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789048934.880309:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048934.880316:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880323:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048934.880327:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880370:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048934.880376:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048934.880381:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048934.880407:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880413:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048934.880420:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880426:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a1d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880439:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048934.880442:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880447:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048934.880450:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880456:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048934.880462:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048934.880472:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789048934.880486:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880491:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048934.880511:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880519:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba1600/0x133f221c08777a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a0f expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880531:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048934.880532:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048934.880534:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048934.880539:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048934.880550:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111526144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048934.880582:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.880606:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048934.880612:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111526272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048934.880635:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048934.880678:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526144 00000100:00100000:1.0:1789048934.880683:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526144 00000100:00100000:1.0:1789048934.880709:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048934.880716:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111526144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048934.880744:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048934.880782:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111526144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048934.880798:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048934.880824:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526272 00000100:00100000:1.0:1789048934.880828:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526272 00010000:00010000:1.0:1789048934.880844:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a16 expref: 21 pid: 22696 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048934.880864:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048934.880871:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3622:x1875953111526272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048934.880881:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048934.880885:0:22689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a16 expref: 21 pid: 22696 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880895:0:22689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777a16 expref: 21 pid: 22696 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.880924:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048934.880948:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3622:x1875953111526272:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (312us total) trans 0 rc 0/0 00010000:00010000:2.0:1789048934.881149:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1400/0x133f221c08777a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777a16 expref: 21 pid: 22696 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048934.881161:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111525888:0@lo:104: 00000100:00100000:2.0:1789048934.881172:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111526016:0@lo:104: 00010000:00010000:2.0:1789048934.881191:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048934.881269:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111526400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048934.881299:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048934.881449:0:22691:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789048934.881457:0:22691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789048934.881502:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789048934.881516:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526400 00000100:00100000:1.0:1789048934.881520:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526400 00010000:00010000:1.0:1789048934.881534:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048934.881549:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048934.881555:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+20:3620:x1875953111526400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048934.881563:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048934.881567:0:22689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881584:0:22689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881596:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3de00/0x133f221c08777a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777a08 expref: 20 pid: 22697 timeout: 789 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881608:0:22689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881616:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789048934.881631:0:22689:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015656362s 00010000:00010000:1.0:1789048934.881635:0:22689:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881643:0:22689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881650:0:22689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881657:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881663:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048934.881668:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.881676:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.888297:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048934.888314:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.888551:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.888564:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1a00/0x133f221c08777ac5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048934.888582:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048934.888670:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a4f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+19:3620:x1875953111526400:12345-0@lo:103:ldlm_bl.0 Request processed in 7111us (7366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048934.888680:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789048934.888773:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111526272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048934.888795:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111526144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048934.889113:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111526400:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789048934.890413:0:24204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789048934.894308:0:24204:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789048934.894319:0:24204:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789048934.894594:0:24204:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789048934.894637:0:24204:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789048934.894661:0:24204:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789048934.894677:0:24204:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789048934.899432:0:24204:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048934.899775:0:24204:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048935.075611:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048935.961992:0:24285:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048935.962716:0:24285:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789048936.093436:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789048936.542176:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048936.542185:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c3fcc0000 from 13 10000000:01000000:1.0:1789048936.542190:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048936.542241:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048936.542254:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048936.542264:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048936.542289:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048936.542401:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048936.542456:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048936.542562:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526528 00000100:00100000:2.0:1789048936.542571:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526528 00000100:00100000:2.0:1789048936.542629:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789048936.542638:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+19:22701:x1875953111526528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048936.542654:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048936.542670:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777acc expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.542705:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777acc expref: 20 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.542717:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777acc expref: 20 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.542736:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0e00, rc 0) 00000100:00100000:2.0:1789048936.542786:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+20:22701:x1875953111526528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048936.542793:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789048936.543137:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048936.543155:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048936.543164:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048936.543224:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048936.543256:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048936.543281:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048936.543544:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526656 00000100:00100000:0.0:1789048936.543549:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526656 00000100:00100000:0.0:1789048936.543578:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789048936.543586:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+20:22701:x1875953111526656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789048936.543601:0:22696:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789048936.543624:0:22696:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789048936.543627:0:22696:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789048936.543715:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+20:22701:x1875953111526656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048936.543733:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789048936.544157:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789048936.544217:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789048936.544224:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.544233:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048936.544243:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789048936.544245:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c2e493000 from 13 10000000:01000000:2.0:1789048936.544248:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789048936.544270:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.544277:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.544286:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048936.544307:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048936.544362:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048936.544392:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c19e4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048936.544450:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526784 00000100:00100000:3.0:1789048936.544455:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526784 00000100:00100000:3.0:1789048936.544483:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789048936.544489:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+20:22701:x1875953111526784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048936.544497:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048936.544509:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777ada expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048936.544527:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777ada expref: 21 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048936.544535:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777ada expref: 21 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048936.544543:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef3c800, rc 0) 00000100:00100000:3.0:1789048936.544580:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111526784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048936.544586:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789048936.544761:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048936.544774:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048936.544783:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048936.544822:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789048936.544850:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048936.544876:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c19e4d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048936.544950:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111526912 00000100:00100000:3.0:1789048936.544956:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111526912 00000100:00100000:3.0:1789048936.544985:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789048936.544991:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111526912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789048936.545002:0:22699:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789048936.545014:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789048936.545021:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789048936.545099:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111526912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048936.545116:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789048936.545298:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111526912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789048936.545379:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789048936.545385:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048936.545391:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789048936.605928:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048937.124811:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048938.144569:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048939.165675:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048940.008723:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048940.008740:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111527040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048940.008806:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048940.008850:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527040 00000100:00100000:2.0:1789048940.008868:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527040 00000100:00100000:2.0:1789048940.008913:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789048940.008922:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111527040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048940.008956:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048940.009003:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111527040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048940.009010:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789048940.009064:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111527040:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789048940.012102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048940.012109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048940.012111:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048940.012115:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789048940.012124:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048940.012127:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789048940.012227:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111527168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048940.012294:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048940.012365:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048940.012371:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111527296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048940.012405:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048940.012442:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527296 00000100:00100000:2.0:1789048940.012454:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527296 00000100:00100000:2.0:1789048940.012501:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789048940.012510:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3622:x1875953111527296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048940.012561:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3622:x1875953111527296:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048940.012568:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789048940.012602:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527168 00000100:00100000:2.0:1789048940.012606:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527168 00000100:00100000:2.0:1789048940.012627:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789048940.012633:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111527168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048940.012661:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048940.012693:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111527168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048940.012699:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789048940.012731:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111527296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048940.012746:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111527168:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789048940.012847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789048940.012851:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789048940.012919:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111527552:0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.012951:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048940.012973:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048940.012979:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111527424:0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013001:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048940.013017:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111527936:0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013040:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048940.013066:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527424 00000100:00100000:0.0:1789048940.013071:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527424 00000100:00100000:0.0:1789048940.013089:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789048940.013096:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111527424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013146:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111527424:12345-0@lo:400:kworker.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048940.013152:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789048940.013173:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527552 00000100:00100000:0.0:1789048940.013176:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527552 00000100:00100000:0.0:1789048940.013199:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527936 00000100:00100000:0.0:1789048940.013201:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527936 00000100:00100000:0.0:1789048940.013221:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048940.013227:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111527552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013256:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111527552:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048940.013261:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048940.013272:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048940.013278:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111527936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013305:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111527936:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048940.013311:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048940.013364:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111527424:0@lo:400:kworker.0 00010000:00080000:0.0:1789048940.013377:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d312300 x1875953111527936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048940.013444:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111527936:0@lo:400:kworker.0 00010000:00080000:0.0:1789048940.013454:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d311500 x1875953111527552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048940.013461:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111527552:0@lo:400:kworker.0 00000100:00080000:3.0:1789048940.013570:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048940.013582:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111527808:0@lo:400:kworker.0 00000100:00100000:3.0:1789048940.013610:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048940.013634:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048940.013639:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111527680:0@lo:400:kworker.0 00000100:00100000:3.0:1789048940.013658:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048940.013752:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527808 00000100:00100000:0.0:1789048940.013763:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527808 00000100:00100000:0.0:1789048940.013834:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111527680 00000100:00100000:0.0:1789048940.013838:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111527680 00000100:00100000:0.0:1789048940.013852:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048940.013870:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111527808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013909:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875953111527808:12345-0@lo:400:kworker.0 Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048940.013915:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048940.013925:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048940.013931:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111527680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048940.013955:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111527680:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048940.013961:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789048940.013986:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d312a00 x1875953111527680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048940.013996:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111527680:0@lo:400:kworker.0 00010000:00080000:0.0:1789048940.014010:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d311f80 x1875953111527808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048940.014018:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3623:1875953111527808:0@lo:400:kworker.0 00000100:00080000:3.0:1789048940.019814:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789048940.192623:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789048941.154367:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048941.216747:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789048941.834306:0:24575:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789048942.238493:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789048943.073309:0:24627:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789048943.073792:0:24627:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789048943.261694:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789048944.076261:0:24677:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789048944.076690:0:24677:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789048944.096473:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048929/real 1789048929] req@ffff959b080a3b80 x1875953111522304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048944 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048944.096511:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080a3b80 x1875953111522304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048944 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048944.096523:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048929/real 1789048929] req@ffff959b080a2680 x1875953111522432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048944 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048944.096536:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080a2680 x1875953111522432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048944 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048944.096557:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048944.096567:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048944.096571:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111522304:0@lo:8:kworker.0 00000100:00080000:2.0:1789048944.096577:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048944.096582:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048944.096584:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111522432:0@lo:8:kworker.0 00000100:00080000:3.0:1789048944.098460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048944.098466:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048944.098469:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048944.098472:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789048944.098499:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048944.098503:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789048944.098506:0:36:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048944.098513:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 684 00000100:00080000:3.0:1789048944.098518:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789048944.098528:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff959b06839800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048944.098548:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c322c8e00 x1875953111528576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048944.098571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048944.098575:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048944.098577:0:36:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048944.098580:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 684 00000100:00080000:3.0:1789048944.098583:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789048944.098589:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048944.098602:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c322c9880 x1875953111528704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048944.098647:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111528192:0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.098708:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.098748:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111528960:0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.098770:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.098790:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789048944.098794:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111528320:0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.098810:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.098834:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111529088:0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.098850:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.098872:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111528576:0@lo:8:kworker.0 00000100:00100000:3.0:1789048944.098894:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.098915:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111528704:0@lo:8:kworker.0 00000100:00100000:3.0:1789048944.098933:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.098960:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528960 00000100:00100000:3.0:1789048944.098967:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528960 00000100:00100000:1.0:1789048944.100602:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528576 00000100:00100000:1.0:1789048944.100611:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528576 00000100:00100000:1.0:1789048944.100648:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528704 00000100:00100000:1.0:1789048944.100652:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528704 00000100:00100000:1.0:1789048944.100667:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048944.100687:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111528576:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789048944.100719:0:24209:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 698 last 0 00000020:00000080:1.0:1789048944.100749:0:24209:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777ae8 00002000:00100000:1.0:1789048944.100765:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff959c2aea6000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789048944.100769:0:24209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789048944.100771:0:24209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789048944.100961:0:24209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789048944.100996:0:24209:0:(import.c:65:import_set_state_nolock()) ffff959c2aea2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048944.101071:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111528576:12345-0@lo:8:kworker.0 Request processed in 384us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048944.101078:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789048944.101095:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789048944.101099:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111528704:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789048944.101110:0:24209:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789048944.101135:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111528704:12345-0@lo:8:kworker.0 Request processed in 35us (2201us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789048944.101141:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789048944.101189:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322c8e00 x1875953111528576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048944.101200:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789048944.101208:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1789048944.101215:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:1.0:1789048944.101219:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789048944.101222:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b06839800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789048944.101244:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789048944.101256:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111528576:0@lo:8:kworker.0 00000100:00080000:1.0:1789048944.101275:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789048944.101280:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789048944.101283:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111528704:0@lo:8:kworker.0 00000004:00080000:1.0:1789048944.101359:0:23446:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789048944.101379:0:23446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1875953111529344:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789048944.101410:0:23446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048944.101430:0:23446:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c195db9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048944.101443:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529344 00000100:00100000:1.0:1789048944.101446:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529344 00000100:00100000:1.0:1789048944.101480:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048944.101487:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23446:x1875953111529344:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:1.0:1789048944.101702:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789048944.101733:0:23445:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789048944.101798:0:23445:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 698855463798ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789048944.101804:0:23445:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789048944.103939:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528320 00000100:00100000:3.0:1789048944.103958:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528320 00000100:00100000:3.0:1789048944.103976:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529088 00000100:00100000:3.0:1789048944.103980:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529088 00000100:00100000:3.0:1789048944.103999:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048944.104008:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111528960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.104096:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875953111528960:12345-0@lo:400:kworker.0 Request processed in 90us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048944.104104:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789048944.104119:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048944.104126:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.104154:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111528320:12345-0@lo:400:kworker.0 Request processed in 29us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048944.104159:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789048944.104170:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789048944.104176:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111529088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.104202:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111529088:12345-0@lo:400:kworker.0 Request processed in 26us (5350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048944.104207:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789048944.104259:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322cb100 x1875953111528320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048944.104275:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111528320:0@lo:400:kworker.0 00010000:00080000:3.0:1789048944.104287:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322c8700 x1875953111529088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048944.104295:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111529088:0@lo:400:kworker.0 00010000:00080000:3.0:1789048944.104306:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322caa00 x1875953111528960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048944.104320:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3622:1875953111528960:0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.105523:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111528064:0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.105585:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048944.105634:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111528832:0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.105659:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048944.105699:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048944.105706:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111528448:0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.105729:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048944.105747:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111529216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048944.105771:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048944.105814:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528192 00000100:00100000:0.0:1789048944.105832:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528192 00000100:00100000:0.0:1789048944.105864:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528448 00000100:00100000:0.0:1789048944.105866:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528448 00000100:00100000:0.0:1789048944.105879:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789048944.105886:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111528192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.105935:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111528192:12345-0@lo:400:kworker.0 Request processed in 49us (7227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048944.105942:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789048944.105956:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789048944.105962:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111528448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.105991:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111528448:12345-0@lo:400:kworker.0 Request processed in 29us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048944.105996:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789048944.106015:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528832 00000100:00100000:0.0:1789048944.106018:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528832 00000100:00100000:0.0:1789048944.106034:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048944.106040:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.106066:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111528832:12345-0@lo:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048944.106071:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789048944.106284:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111528192:0@lo:400:kworker.0 00000100:00100000:0.0:1789048944.106320:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111528448:0@lo:400:kworker.0 00010000:00080000:0.0:1789048944.106331:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322cbb80 x1875953111528832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048944.106363:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111528832:0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.106519:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111528064 00000100:00100000:3.0:1789048944.106523:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111528064 00000100:00100000:3.0:1789048944.106561:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789048944.106568:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3621:x1875953111528064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048944.106604:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3621:x1875953111528064:12345-0@lo:400:kworker.0 Request processed in 37us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048944.106609:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789048944.106639:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111528064:0@lo:400:kworker.0 00000004:00080000:0.0:1789048944.109084:0:23437:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789048944.109396:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529216 00000100:00100000:2.0:1789048944.109405:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529216 00000100:00100000:2.0:1789048944.109531:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048944.109542:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1875953111529216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048944.109573:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048944.109650:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3621:x1875953111529216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (3877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048944.109657:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789048944.110288:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048944.110295:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789048944.110478:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd1180 x1875953111529216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048944.110500:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111529216:0@lo:13:osp-pre-0-1.0 00002000:00080000:1.0:1789048944.120290:0:24209:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789048944.120303:0:24209:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789048944.120455:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23446:x1875953111529344:12345-0@lo:7:osp-pre-0-1.0 Request processed in 18965us (19041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048944.120466:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789048944.120589:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd1c00 x1875953111529344/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789048960 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048944.120605:0:23446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1875953111529344:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789048944.120619:0:23446:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789048944.120661:0:23446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1875953111529472:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789048944.120695:0:23446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.120724:0:23446:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789048944.120783:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529472 00000100:00100000:1.0:1789048944.120789:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529472 00000100:00100000:1.0:1789048944.120831:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048944.120839:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23446:x1875953111529472:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789048944.120860:0:24211:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789048944.121668:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23446:x1875953111529472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 827us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048944.121677:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789048944.133512:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c08a8c700 x1875953111529472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048960 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048944.133534:0:23446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1875953111529472:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789048944.133570:0:23446:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1789048944.133648:0:23446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1875953111529600:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789048944.133704:0:23446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048944.133739:0:23446:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0745fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789048944.133954:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529600 00000100:00100000:0.0:1789048944.133962:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529600 00000100:00100000:0.0:1789048944.134016:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789048944.134026:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23446:x1875953111529600:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789048944.134080:0:24209:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:1.0:1789048944.180012:0:24205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1789048944.180026:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789048944.181629:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23446:x1875953111529600:12345-0@lo:5:osp-pre-0-1.0 Request processed in 47596us (47916us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789048944.181646:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789048944.181661:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c08a8c700 x1875953111529600/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789048960 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048944.181675:0:23446:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789048944.181682:0:23446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23446:1875953111529600:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789048944.181700:0:23446:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1789048944.181758:0:23446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23446:1875953111529728:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789048944.181793:0:23446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048944.181844:0:23446:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b0793aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789048944.181912:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529728 00000100:00100000:2.0:1789048944.181920:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529728 00000100:00100000:2.0:1789048944.181959:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048944.181968:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23446:x1875953111529728:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789048944.182011:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23446:x1875953111529728:12345-0@lo:900:osp-pre-0-1.0 Request processed in 45us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048944.182017:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789048944.182049:0:23446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3d312300 x1875953111529728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048960 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048944.182059:0:23446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23446:1875953111529728:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1789048944.285464:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048945.119374:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111529856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048945.119451:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048945.119510:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529856 00000100:00100000:3.0:1789048945.119517:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529856 00000100:00100000:3.0:1789048945.119560:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048945.119567:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111529856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789048945.119597:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789048945.119650:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111529856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048945.119656:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048945.119699:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111529856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048945.124488:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111529984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048945.124563:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048945.124639:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111529984 00000100:00100000:1.0:1789048945.124648:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111529984 00000100:00100000:1.0:1789048945.124697:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048945.124706:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111529984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048945.124742:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048945.124803:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111529984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048945.124819:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048945.124867:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111529984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789048945.309597:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048946.337828:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048946.850870:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048947.357999:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048948.384384:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048949.214610:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789048949.214637:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111530112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048949.214710:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048949.214794:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530112 00000100:00100000:2.0:1789048949.214803:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530112 00000100:00100000:2.0:1789048949.215039:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048949.215050:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111530112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048949.215086:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1789048949.215192:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048949.215296:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111530112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 248us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048949.215304:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789048949.216502:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048949.216508:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048949.216511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048949.216514:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789048949.216544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048949.216547:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048949.216551:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048949.216557:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 698 00000100:00080000:1.0:1789048949.216575:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789048949.216585:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048949.216605:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd0000 x1875953111530752/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048949.217643:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048929/real 1789048929] req@ffff959b080a1c00 x1875953111521920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048949 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048949.217689:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080a1c00 x1875953111521920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048949 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048949.217700:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789048929/real 1789048929] req@ffff959b080a2300 x1875953111522048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048949 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048949.217711:0:3619:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff959b080a2300 x1875953111522048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789048949 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048949.217733:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111530752:0@lo:8:kworker.0 00000100:00100000:2.0:1789048949.217802:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789048949.217851:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048949.217868:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048949.217872:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111521920:0@lo:8:kworker.0 00000100:00080000:2.0:1789048949.217877:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048949.217882:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789048949.217885:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111522048:0@lo:8:kworker.0 00000100:00080000:2.0:1789048949.217915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048949.217918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789048949.217920:0:8:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048949.217924:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:2.0:1789048949.217928:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789048949.217935:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff959b07589000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048949.217954:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a2300 x1875953111531264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789048949.217981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789048949.217984:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789048949.217986:0:8:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789048949.217988:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 684 00000100:00080000:2.0:1789048949.217991:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789048949.217995:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789048949.218006:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b080a1c00 x1875953111531392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789048949.218027:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111531264:0@lo:8:kworker.0 00000100:00100000:2.0:1789048949.218050:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048949.218075:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111531392:0@lo:8:kworker.0 00000100:00100000:2.0:1789048949.218094:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048949.218649:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530752 00000100:00100000:2.0:1789048949.218657:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530752 00000100:00100000:2.0:1789048949.218679:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531264 00000100:00100000:2.0:1789048949.218681:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531264 00000100:00100000:2.0:1789048949.218688:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531392 00000100:00100000:2.0:1789048949.218690:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531392 00000100:00100000:2.0:1789048949.218701:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048949.218708:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111530752:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789048949.218734:0:24211:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048949.218789:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111530752:12345-0@lo:8:kworker.0 Request processed in 79us (986us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048949.218796:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048949.218812:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048949.218836:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111531264:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789048949.218856:0:24211:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 703 last 0 00000020:00000080:2.0:1789048949.218886:0:24211:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08777aef 00002000:00100000:2.0:1789048949.218901:0:24211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff959c3e9bd800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789048949.218905:0:24211:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789048949.218907:0:24211:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789048949.218993:0:24211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789048949.219023:0:24211:0:(import.c:65:import_set_state_nolock()) ffff959c3e9bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048949.219062:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111531264:12345-0@lo:8:kworker.0 Request processed in 226us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048949.219068:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048949.219080:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048949.219083:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111531392:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789048949.219093:0:24211:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789048949.219249:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111531392:12345-0@lo:8:kworker.0 Request processed in 163us (1153us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789048949.219255:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789048949.219292:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b080a2300 x1875953111531264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048949.219301:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048949.219309:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789048949.219316:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789048949.219321:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789048949.219323:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b07589000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789048949.219361:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789048949.219372:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111531264:0@lo:8:kworker.0 00000100:00080000:2.0:1789048949.219386:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048949.219390:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048949.219392:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111531392:0@lo:8:kworker.0 00000100:00080000:2.0:1789048949.219401:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048949.219404:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789048949.219406:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111530752:0@lo:8:kworker.0 00000004:00080000:2.0:1789048949.219451:0:22729:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789048949.219466:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1875953111531648:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789048949.219493:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048949.219509:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048949.219520:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531648 00000100:00100000:2.0:1789048949.224022:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531648 00000100:00100000:2.0:1789048949.224127:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048949.224138:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22729:x1875953111531648:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789048949.224939:0:22728:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789048949.225028:0:22728:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 703978694016ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789048949.225035:0:22728:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1789048949.227850:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b080a2680 x1875953111530112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048949.227879:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111530112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789048949.227912:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111530496:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.227977:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228016:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111531136:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.228038:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228077:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789048949.228084:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111530624:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.228124:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228146:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111531520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048949.228172:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228206:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111530240:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.228237:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228263:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111530880:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.228285:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228305:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789048949.228312:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111530368:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.228351:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048949.228369:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111531008:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.228387:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789048949.228411:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048949.228426:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530624 00000100:00100000:3.0:1789048949.228433:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530624 00000100:00100000:3.0:1789048949.228467:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530368 00000100:00100000:3.0:1789048949.228469:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530368 00000100:00100000:3.0:1789048949.228486:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048949.228496:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111530624:12345-0@lo:400:kworker.0 00002000:00080000:2.0:1789048949.229191:0:24211:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789048949.229201:0:24211:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:2.0:1789048949.229206:0:24211:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000100:00100000:1.0:1789048949.229703:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530496 00000100:00100000:1.0:1789048949.229710:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530496 00000100:00100000:1.0:1789048949.229742:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531136 00000100:00100000:1.0:1789048949.229745:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531136 00000100:00100000:1.0:1789048949.229782:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530880 00000100:00100000:1.0:1789048949.229786:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530880 00000100:00100000:1.0:1789048949.229797:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531008 00000100:00100000:1.0:1789048949.229799:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531008 00000100:00100000:1.0:1789048949.229827:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048949.229835:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048949.229894:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111530496:12345-0@lo:400:kworker.0 Request processed in 59us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048949.229901:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048949.229917:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789048949.229924:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111531136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048949.229951:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111531136:12345-0@lo:400:kworker.0 Request processed in 28us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048949.229956:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789048949.229968:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048949.229973:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111530880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048949.230003:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111530880:12345-0@lo:400:kworker.0 Request processed in 30us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048949.230019:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048949.230031:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789048949.230036:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111531008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048949.230064:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111531008:12345-0@lo:400:kworker.0 Request processed in 28us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048949.230069:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048949.230243:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111530624:12345-0@lo:400:kworker.0 Request processed in 1747us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048949.230252:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789048949.230270:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048949.230277:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.230318:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111530368:12345-0@lo:400:kworker.0 Request processed in 42us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048949.230324:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789048949.230356:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111530240 00000100:00100000:3.0:1789048949.230360:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111530240 00000100:00100000:3.0:1789048949.230388:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789048949.230394:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3620:x1875953111530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.230423:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3620:x1875953111530240:12345-0@lo:400:kworker.0 Request processed in 29us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048949.230428:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789048949.230461:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048949.230465:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789048949.230495:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111530368:0@lo:400:kworker.0 00010000:00080000:3.0:1789048949.230510:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd2a00 x1875953111531008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048949.230521:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111531008:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.231728:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111530240:0@lo:400:kworker.0 00010000:00080000:3.0:1789048949.231744:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd3480 x1875953111530880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048949.231755:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111530880:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.231828:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111530624:0@lo:400:kworker.0 00010000:00080000:3.0:1789048949.231841:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd0e00 x1875953111530496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048949.231865:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111530496:0@lo:400:kworker.0 00010000:00080000:3.0:1789048949.231879:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd3b80 x1875953111531136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048949.231887:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111531136:0@lo:400:kworker.0 00000100:00100000:3.0:1789048949.231920:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531520 00000100:00100000:3.0:1789048949.231925:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531520 00000100:00100000:3.0:1789048949.231970:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048949.231977:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111531520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048949.231998:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048949.232052:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875953111531520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (3879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048949.232058:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789048949.232083:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959b080a1c00 x1875953111531520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789048949.233391:0:22684:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789048949.234618:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111531520:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1789048949.251571:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048949.251583:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251600:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1789048949.251605:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048949.251611:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251644:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251654:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251662:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251680:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048949.251694:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048949.251700:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251709:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048949.251713:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251724:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251740:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251748:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777af6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.251787:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.251789:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.251792:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.253276:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.253287:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.253300:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.253304:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.253318:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.253554:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.253566:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.253574:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.255887:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.256294:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.256303:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.256316:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.256322:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.256357:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.256388:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.256396:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4d002ad/0x133f221c08777afd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.256418:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.256420:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.256422:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.262661:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.262676:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.262692:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.262697:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.262704:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.262720:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.262730:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.262737:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.268655:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048949.270267:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048949.270281:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.270297:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3dc00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048949.270302:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.270313:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.270351:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.270359:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff20c76b/0x133f221c08777b04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.270382:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.270384:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.270385:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048949.277898:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048949.277914:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.277945:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1789048949.277950:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048949.277957:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.277973:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.277985:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.277993:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.278018:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048949.278497:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048949.278506:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.278516:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048949.278521:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.278531:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.278557:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.278565:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.278583:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.278585:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.278593:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048949.290494:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048949.290509:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.291214:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1789048949.291222:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048949.291228:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.291245:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.291268:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.291277:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.291388:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789048949.293698:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048949.293711:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.293728:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=704s v=(0 0) 00010000:00010000:2.0:1789048949.293733:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048949.293739:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.293752:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.293762:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.293780:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.293863:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048949.293872:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.293880:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba0000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.293884:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.293893:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.293911:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.293917:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5365b0/0x133f221c08777b12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.295227:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048949.295240:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.295252:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048949.295256:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.295266:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.295283:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.295294:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.295296:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.295299:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.298725:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789048949.298741:0:24211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077ebec82/0x133f221c08777b19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.299076:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048949.304926:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048949.304942:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.304960:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1789048949.304965:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048949.304972:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.305006:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.305018:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.305026:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.305055:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048949.305405:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048949.305412:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.305421:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048949.305427:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.305436:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.305457:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.305464:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.305484:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.305486:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.305487:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048949.305958:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048949.305966:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.305976:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1789048949.305979:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048949.305984:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.305993:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306000:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306018:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306042:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048949.306201:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048949.306211:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.306219:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048949.306223:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.306231:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.306244:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.306252:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bfc0fd1/0x133f221c08777b27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.306265:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.306267:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.306269:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048949.306492:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048949.306498:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306507:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1789048949.306511:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048949.306515:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306534:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306543:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.306549:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.307400:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.307605:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.307613:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.307622:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.307626:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.307645:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.307660:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.307667:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777b2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.307681:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.307682:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.307683:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.320574:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.320588:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.320606:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.320610:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.320615:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.320631:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.320640:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.320654:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.325902:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048949.326974:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.326986:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327003:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.327008:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.327014:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327028:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327038:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327045:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327063:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789048949.327073:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048949.327079:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327217:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.327223:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327233:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327251:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327259:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327275:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.327278:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327284:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.327286:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327293:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327301:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327315:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327327:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.327329:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.327350:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.327668:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.327759:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.327776:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327785:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.327788:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.327792:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327801:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327809:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327816:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.327832:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048949.328297:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.328310:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.328319:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.328323:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.328327:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.328811:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.328820:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.328827:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.328851:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048949.329443:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.329451:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.329460:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.329463:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.329473:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.329490:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.329504:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abd10f62/0x133f221c08777b4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.329520:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.329531:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.329533:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.330232:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789048949.330240:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.330250:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.330253:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.330262:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.330282:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.330291:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.330306:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.330307:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.330309:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.331367:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.331376:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.331390:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.331395:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.331402:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.331415:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.331424:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.331432:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.331462:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048949.331603:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.331610:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.331617:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.331621:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.331629:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.331643:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.331650:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029f7b11c/0x133f221c08777b51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.331665:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.331667:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.331669:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.337060:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.337076:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.337095:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.337109:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.337116:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.337132:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.337142:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.337150:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.337177:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048949.337321:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048949.337328:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.337349:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048949.337353:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.337374:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.337392:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.337399:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2528a3/0x133f221c08777b58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048949.337416:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.337417:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048949.337419:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.339710:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.339724:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.339740:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.339745:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.339750:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.339774:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.339784:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.339792:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.339816:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.339899:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.339906:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.339915:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.339930:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.339938:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.339953:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.339960:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000577d1856/0x133f221c08777b5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.339975:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.339977:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.339978:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.340261:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.340267:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.340276:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.340280:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.340284:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.340304:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.340312:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.340320:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.340359:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.340366:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.340371:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.340378:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.340382:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.340390:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.340401:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.340415:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080605cf3/0x133f221c08777b66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.340427:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.340429:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.340430:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.341250:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.341259:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.341270:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.341273:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.341277:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.341287:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.341294:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.341313:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.341361:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.341821:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.341829:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.341837:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.341841:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.341849:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.341865:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.341872:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea241afa/0x133f221c08777b6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.341889:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.341890:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.341891:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.344257:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.344269:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344284:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.344289:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.344295:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344308:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344318:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344325:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344359:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.344371:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.344376:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344384:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.344389:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344409:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344426:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344433:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777b74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.344449:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.344450:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.344452:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.345222:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.345229:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.345240:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.345243:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.345248:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.345259:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.345267:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.345280:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.346182:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048949.346638:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.346645:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.346659:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.346663:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.346668:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.346679:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.346687:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.346693:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346774:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789048949.346782:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346802:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048949.346806:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346824:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346843:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346850:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777b7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346867:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048949.346871:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346877:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048949.346880:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346887:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346895:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.346910:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.346912:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.346914:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.350495:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789048949.350513:0:24211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777b82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.351444:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.352572:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.352583:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.352599:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.352605:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.352611:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.352626:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.352636:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.352644:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.352660:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048949.352717:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048949.352724:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.352733:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048949.352738:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.352746:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.352775:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.352783:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777b89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.352797:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.352799:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.352800:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.361829:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.361850:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361867:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.361872:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.361879:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361895:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361906:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361914:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361931:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048949.361942:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.361948:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361956:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.361961:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361970:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.361993:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.362000:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3a68e6c/0x133f221c08777b90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.362017:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.362019:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.362021:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.364828:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.364843:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.364861:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.364866:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.364873:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.366357:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.366383:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.366391:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.366432:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789048949.367314:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048949.367326:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.367362:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048949.367366:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.367376:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.367394:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.367401:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e70aa6/0x133f221c08777b97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.367417:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.367419:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048949.367420:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048949.368661:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048949.368673:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.368688:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1789048949.368693:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048949.368699:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.368712:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.368729:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.368738:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.368753:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048949.369091:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.369099:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.369107:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.369111:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.369121:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.369137:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.369145:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017bd5356/0x133f221c08777b9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.369161:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.369162:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.369164:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048949.369969:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048949.369978:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.369990:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=704s v=(0 0) 00010000:00010000:1.0:1789048949.369994:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048949.370000:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.370011:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.370020:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.370028:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048949.370053:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048949.370201:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048949.370208:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.370216:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048949.370220:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.370229:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.370243:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.370250:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbb4b488/0x133f221c08777ba5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.370265:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.370267:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.370268:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.374374:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.374387:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374404:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.374416:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.374422:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374439:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374449:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374457:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374473:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048949.374484:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.374490:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374497:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.374501:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374509:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374698:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374718:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075ab6520/0x133f221c08777bac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.374735:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.374737:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.374739:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048949.379183:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.379198:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379216:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.379221:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.379228:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379244:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379254:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379262:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379286:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789048949.379953:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048949.379965:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379976:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=704s v=(0 0) 00010000:00010000:0.0:1789048949.379980:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048949.379985:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.379995:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380003:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380011:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380026:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789048949.380035:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048949.380041:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380049:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.380054:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380063:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380085:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380093:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee31bd6e/0x133f221c08777bb3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380111:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.380114:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380120:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.380123:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380131:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380140:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380147:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068aff6dc/0x133f221c08777bba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380159:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.380161:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.380169:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048949.380286:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.380695:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.380701:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.380710:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.380718:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.380721:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.380730:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.380735:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.380740:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.380752:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048949.380784:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.380789:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380797:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.380801:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380809:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380915:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380922:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ba5a55/0x133f221c08777bc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.380937:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.380939:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.380940:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.381237:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.381242:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381248:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.381250:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.381253:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381260:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381264:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381274:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381288:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048949.381310:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.381316:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.381323:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.381326:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.381363:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.381375:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.381383:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029918e1e/0x133f221c08777bc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.381396:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.381397:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.381399:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048949.381846:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048949.381853:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381863:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=704s v=(0 0) 00010000:00010000:3.0:1789048949.381867:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048949.381872:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381882:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381891:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381897:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048949.381911:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789048949.382290:0:24211:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1789048949.382410:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22729:x1875953111531648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 158270us (162912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048949.382428:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048949.382432:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1875953111531648:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789048949.382447:0:22729:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789048949.382496:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1875953111531776:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789048949.382548:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048949.382581:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b069760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048949.382806:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531776 00000100:00100000:3.0:1789048949.382814:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531776 00000100:00100000:3.0:1789048949.382866:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048949.382875:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22729:x1875953111531776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789048949.382918:0:24210:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:0.0:1789048949.382930:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048949.382937:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.382949:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048949.382953:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.382964:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.382981:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.383000:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3b016d8/0x133f221c08777bcf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048949.383018:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.383020:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048949.383022:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789048949.397585:0:24205:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1789048949.397633:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789048949.398126:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22729:x1875953111531776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15248us (15573us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789048949.398139:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048949.398322:0:22729:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789048949.398609:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22729:1875953111531776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789048949.398627:0:22729:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1789048949.406492:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048950.239415:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111531904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048950.239488:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048950.239550:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111531904 00000100:00100000:1.0:1789048950.239557:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111531904 00000100:00100000:1.0:1789048950.239601:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789048950.239610:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111531904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048950.239641:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048950.239685:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111531904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048950.239692:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789048950.239751:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111531904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789048950.241442:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048950.241462:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111532032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048950.241518:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048950.241565:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532032 00000100:00100000:2.0:1789048950.241572:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532032 00000100:00100000:2.0:1789048950.241613:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048950.241620:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111532032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048950.241666:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048950.241707:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111532032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048950.241714:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048950.241768:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111532032:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789048950.432114:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789048950.989206:0:25023:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789048950.989209:0:25023:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789048950.989211:0:25023:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789048950.989474:0:25023:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff959c3e9b8000 00000020:01000004:2.0:1789048950.989488:0:25023:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789048950.989503:0:25023:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789048950.989518:0:25023:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff959b07923380) 00000020:00000080:2.0:1789048950.989534:0:25023:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789048951.061688:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789048951.062472:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789048951.062869:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789048951.063651:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789048951.064319:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789048951.067406:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789048951.068661:0:25023:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:1.0:1789048951.090571:0:25023:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789048951.090832:0:25023:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789048951.090846:0:25023:0:(osd_handler.c:8921:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789048951.090858:0:25023:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x133f221c08777bdd 00000020:01000004:1.0:1789048951.090865:0:25023:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789048951.090884:0:25023:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789048951.090887:0:25023:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789048951.090893:0:25023:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789048951.090921:0:25023:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1789048951.090926:0:25023:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789048951.114906:0:25023:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789048951.114946:0:25023:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789048951.114950:0:25023:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789048951.114952:0:25023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048951.114953:0:25023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048951.114954:0:25023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048951.114956:0:25023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048951.114957:0:25023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048951.114958:0:25023:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048951.114960:0:25023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048951.114961:0:25023:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048951.114965:0:25023:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789048951.114967:0:25023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048951.114968:0:25023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048951.114969:0:25023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048951.114970:0:25023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048951.114971:0:25023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048951.114972:0:25023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048951.114973:0:25023:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048951.114974:0:25023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048951.114975:0:25023:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789048951.115065:0:25023:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789048951.115087:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532160:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789048951.115165:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.115225:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789048951.116320:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532160 00000100:00100000:2.0:1789048951.116361:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532160 00000100:00100000:2.0:1789048951.116426:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789048951.116435:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:25023:x1875953111532160:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789048951.116489:0:22699:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789048951.116492:0:22699:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789048951.116496:0:22699:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789048951.116909:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:25023:x1875953111532160:12345-0@lo:253:mount.lustre.0 Request processed in 474us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.116923:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789048951.117267:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532160:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789048951.117280:0:25023:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789048951.117283:0:25023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789048951.117285:0:25023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048951.117286:0:25023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048951.117287:0:25023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048951.117288:0:25023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048951.117289:0:25023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048951.117290:0:25023:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048951.117292:0:25023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048951.117293:0:25023:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789048951.117315:0:25023:0:(tgt_mount.c:101:server_register_mount()) register mount ffff959c3e9b8000 from lustre-OST0001 10000000:01000000:0.0:1789048951.117363:0:25023:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789048951.117366:0:25023:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789048951.117375:0:25023:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff959c394b99c0 local copy 00010000:00010000:0.0:1789048951.117385:0:25023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.117481:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048951.117516:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.118548:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540180 going to sleep for 11 seconds 00000100:00100000:3.0:1789048951.127591:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532288 00000100:00100000:3.0:1789048951.127607:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532288 00000100:00100000:3.0:1789048951.127681:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789048951.127692:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:25023:x1875953111532288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789048951.128221:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:25023:x1875953111532288:12345-0@lo:501:mount.lustre.0 Request processed in 529us (10702us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789048951.128230:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789048951.128573:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532288:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789048951.128598:0:25023:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789048951.128625:0:25023:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789048951.128634:0:25023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.128644:0:25023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060e00/0x133f221c08777810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777817 expref: -99 pid: 22683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048951.128696:0:25023:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff959c3e9b8000 10000000:01000000:0.0:1789048951.128701:0:25023:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789048951.128707:0:25023:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789048951.128710:0:25023:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789048951.128714:0:25023:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789048951.128718:0:25023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789048951.128762:0:25023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.128770:0:25023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.128779:0:25023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.128943:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048951.128987:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.129037:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540180 going to sleep for 11 seconds 00000100:00100000:2.0:1789048951.129245:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532416 00000100:00100000:2.0:1789048951.129251:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532416 00000100:00100000:2.0:1789048951.129296:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789048951.129305:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:25023:x1875953111532416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789048951.129316:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048951.129363:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1a00/0x133f221c08777beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777be4 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.129386:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1a00/0x133f221c08777beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777be4 expref: 22 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.129397:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1a00/0x133f221c08777beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777be4 expref: 22 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.129405:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1a00, rc 0) 00000100:00100000:2.0:1789048951.129444:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532416:12345-0@lo:101:mount.lustre.0 Request processed in 141us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.129451:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789048951.129545:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048951.129568:0:25023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777beb expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048951.129577:0:25023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777beb expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789048951.130809:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789048951.131766:0:25023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789048951.135872:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789048951.135942:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789048951.135963:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789048951.135979:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789048951.135994:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789048951.136008:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789048951.136022:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789048951.136038:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789048951.136053:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1789048951.136080:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1789048951.136095:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1789048951.136213:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048951.136283:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.136320:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.136769:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532544 00000100:00100000:0.0:1789048951.136779:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532544 00000100:00100000:0.0:1789048951.136847:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789048951.136857:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048951.137037:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532544:12345-0@lo:501:mount.lustre.0 Request processed in 181us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.137044:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789048951.137466:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048951.137507:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048951.137563:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.137584:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.137702:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532672 00000100:00100000:0.0:1789048951.137707:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532672 00000100:00100000:0.0:1789048951.137756:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789048951.137764:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532672:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048951.143776:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532672:12345-0@lo:503:mount.lustre.0 Request processed in 6004us (6203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.143792:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789048951.143976:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532672:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789048951.144588:0:25023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789048951.144689:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048951.144744:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.144794:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b06976c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.145365:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532800 00000100:00100000:0.0:1789048951.145373:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532800 00000100:00100000:0.0:1789048951.145422:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789048951.145432:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.146543:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532800:12345-0@lo:502:mount.lustre.0 Request processed in 1099us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.146554:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789048951.146688:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080a0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048951.146939:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789048951.146971:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789048951.146986:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789048951.147014:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789048951.147030:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789048951.147044:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789048951.147059:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789048951.147072:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789048951.147086:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1789048951.147128:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048951.147187:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048951.147225:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c053466c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.147548:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111532928 00000100:00100000:0.0:1789048951.147557:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111532928 00000100:00100000:0.0:1789048951.147609:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789048951.147617:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.147716:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111532928:12345-0@lo:502:mount.lustre.0 Request processed in 100us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.147723:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789048951.148015:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111532928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048951.148067:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789048951.148078:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789048951.149192:0:25027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789048951.149202:0:25027:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789048951.149209:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.149211:0:25027:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789048951.149216:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789048951.149239:0:25027:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff959c20a019c0) 00000020:00000080:1.0:1789048951.149263:0:25027:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789048951.149270:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789048951.149391:0:25027:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3e9b8000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789048951.149400:0:25027:0:(osd_handler.c:8921:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789048951.149407:0:25027:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x133f221c08777bf9 00010000:00010000:2.0:1789048951.158296:0:25027:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789048951.161483:0:25027:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1789048951.162988:0:25027:0:(osd_handler.c:5577:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789048951.171631:0:25027:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789048951.171646:0:25027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048951.171654:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048951.171656:0:25027:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789048951.171660:0:25027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048951.171664:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048951.171665:0:25027:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789048951.171668:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789048951.171669:0:25027:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789048951.171672:0:25027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048951.171674:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048951.171675:0:25027:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789048951.171692:0:25027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789048951.171694:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048951.171696:0:25027:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789048951.171699:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789048951.171730:0:25027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789048951.171733:0:25027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789048951.171735:0:25027:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789048951.171738:0:25027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1789048951.177180:0:25023:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789048951.177229:0:25023:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789048951.177254:0:25023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777beb expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177267:0:25023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39600/0x133f221c08777be4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777beb expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048951.177290:0:25023:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3e9b8000 from 1 10000000:01000000:0.0:1789048951.177293:0:25023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789048951.177363:0:25023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177372:0:25023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177384:0:25023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.177410:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789048951.177485:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.177527:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533056 00000100:00100000:0.0:1789048951.177534:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533056 00000100:00100000:0.0:1789048951.177580:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789048951.177589:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:25023:x1875953111533056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048951.177604:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048951.177620:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777c00 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177646:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777c00 expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177657:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777c00 expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177664:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38400, rc 0) 00000100:00100000:0.0:1789048951.177704:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533056:12345-0@lo:101:mount.lustre.0 Request processed in 116us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.177711:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789048951.177770:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540180 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.177793:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048951.177818:0:25023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.177828:0:25023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048951.179890:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789048951.180200:0:25023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048951.181034:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789048951.181410:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789048951.181435:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789048951.181466:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789048951.181481:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789048951.181493:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789048951.181505:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789048951.181518:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789048951.181531:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789048951.181705:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789048951.181722:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789048951.181744:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789048951.181761:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789048951.181878:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048951.181956:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.182009:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540480 going to sleep for 11 seconds 00000100:00100000:2.0:1789048951.183148:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533184 00000100:00100000:2.0:1789048951.183160:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533184 00000100:00100000:2.0:1789048951.183216:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789048951.183226:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789048951.183400:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533184:12345-0@lo:501:mount.lustre.0 Request processed in 175us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.183408:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789048951.183678:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048951.183733:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048951.183788:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.183830:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540480 going to sleep for 11 seconds 00000100:00100000:2.0:1789048951.185855:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533312 00000100:00100000:2.0:1789048951.185868:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533312 00000100:00100000:2.0:1789048951.185924:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789048951.185934:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789048951.186102:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533312:12345-0@lo:503:mount.lustre.0 Request processed in 169us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.186109:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789048951.186307:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533312:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048951.186770:0:25023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048951.186973:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533440:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.187026:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.187063:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b081603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048951.188189:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533440 00000100:00100000:2.0:1789048951.188198:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533440 00000100:00100000:2.0:1789048951.188263:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789048951.188273:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048951.188431:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533440:12345-0@lo:502:mount.lustre.0 Request processed in 159us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.188438:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789048951.189425:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048951.189669:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789048951.189702:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789048951.189718:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789048951.189731:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789048951.189744:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789048951.189784:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789048951.190496:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789048951.190525:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1789048951.190693:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789048951.190717:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1789048951.190731:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1789048951.190781:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.190864:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.190915:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b081603c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048951.191124:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533568 00000100:00100000:2.0:1789048951.191133:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533568 00000100:00100000:2.0:1789048951.191189:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789048951.191198:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789048951.191324:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533568:12345-0@lo:502:mount.lustre.0 Request processed in 127us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.191359:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789048951.191635:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789048951.191697:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1789048951.191708:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789048951.198141:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048951.198160:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.198163:0:25031:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789048951.198173:0:25031:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c3e9b8000 00000020:00000080:1.0:1789048951.198177:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048951.198187:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048951.198189:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.198190:0:25031:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789048951.198193:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048951.198195:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.198196:0:25031:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789048951.198199:0:25031:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff959c3e9b8000 00000020:00000080:1.0:1789048951.198201:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048951.198317:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048951.198321:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.198322:0:25031:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789048951.198325:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048951.198328:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.198329:0:25031:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048951.198359:0:25031:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c3e9b8000 00000020:00000080:1.0:1789048951.198361:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048951.211505:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048951.211607:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.211611:0:25031:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789048951.211623:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789048951.211627:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.211628:0:25031:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789048951.211640:0:25031:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff959c3e9b8000 00000020:00000080:1.0:1789048951.211643:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789048951.211706:0:25031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789048951.211709:0:25031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789048951.211710:0:25031:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789048951.211713:0:25031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789048951.214500:0:25023:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789048951.214559:0:25023:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789048951.214584:0:25023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048951.214598:0:25023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048951.214662:0:25023:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789048951.214665:0:25023:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff959c3e9b8000 10000000:01000000:1.0:1789048951.214668:0:25023:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff959c3e9b8000 10000000:01000000:1.0:1789048951.214672:0:25023:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789048951.214678:0:25023:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff959c3e9b8000 from 1 10000000:01000000:1.0:1789048951.214681:0:25023:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789048951.214720:0:25023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048951.214729:0:25023:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048951.214740:0:25023:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048951.214787:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533696:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789048951.215022:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048951.215066:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c123b8300 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.216935:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533696 00000100:00100000:0.0:1789048951.216949:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533696 00000100:00100000:0.0:1789048951.217024:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789048951.217033:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:25023:x1875953111533696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789048951.217058:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048951.217076:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef39000/0x133f221c08777c15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777c0e expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.217109:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef39000/0x133f221c08777c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777c0e expref: 24 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.217120:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef39000/0x133f221c08777c15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777c0e expref: 24 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.217129:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39000, rc 0) 00000100:00100000:0.0:1789048951.217197:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111533696:12345-0@lo:101:mount.lustre.0 Request processed in 164us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.217203:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789048951.218217:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789048951.218243:0:25023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c15 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048951.218254:0:25023:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777c15 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048951.224012:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789048951.224414:0:25023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048951.224637:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789048951.224664:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789048951.224679:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789048951.224706:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789048951.224721:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789048951.224735:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789048951.224764:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789048951.224780:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789048951.224794:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789048951.225873:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789048951.225899:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789048951.225916:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789048951.225928:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789048951.225940:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789048951.225967:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789048951.225981:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789048951.226008:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789048951.226025:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789048951.226039:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789048951.226069:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789048951.226086:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789048951.226100:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789048951.226115:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789048951.226129:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789048951.226143:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789048951.226158:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789048951.226172:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789048951.226187:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789048951.226202:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789048951.226214:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789048951.226225:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789048951.226237:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789048951.226248:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789048951.226261:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789048951.226276:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789048951.226304:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789048951.226320:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789048951.226352:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789048951.226370:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789048951.227483:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789048951.227509:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789048951.227524:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789048951.227536:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789048951.227551:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789048951.227565:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789048951.227578:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789048951.227591:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789048951.227618:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789048951.227807:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789048951.227828:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789048951.227860:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789048951.227868:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789048951.227978:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048951.228063:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.228114:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048951.228294:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533824 00000100:00100000:1.0:1789048951.228302:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533824 00000100:00100000:1.0:1789048951.228373:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789048951.228383:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111533824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789048951.228509:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111533824:12345-0@lo:501:mount.lustre.0 Request processed in 128us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048951.228517:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789048951.230610:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789048951.230671:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789048951.230735:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.230782:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048951.231384:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111533952 00000100:00100000:1.0:1789048951.231392:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111533952 00000100:00100000:1.0:1789048951.231444:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789048951.231453:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111533952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789048951.231580:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111533952:12345-0@lo:503:mount.lustre.0 Request processed in 128us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048951.231588:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789048951.232520:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111533952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789048951.232946:0:25023:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789048951.233020:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111534080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.233070:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.233108:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048951.233383:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534080 00000100:00100000:1.0:1789048951.233398:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534080 00000100:00100000:1.0:1789048951.233433:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789048951.233440:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111534080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789048951.233530:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111534080:12345-0@lo:502:mount.lustre.0 Request processed in 90us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048951.233638:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789048951.236351:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111534080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048951.238842:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789048951.238894:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789048951.238909:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789048951.238922:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789048951.238935:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789048951.238949:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789048951.238962:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789048951.238973:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789048951.238987:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789048951.239329:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789048951.239367:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789048951.239473:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789048951.239491:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789048951.239521:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789048951.239537:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789048951.239550:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789048951.239564:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789048951.239579:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789048951.239592:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789048951.239607:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789048951.239620:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789048951.239632:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789048951.239646:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789048951.240328:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789048951.240375:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789048951.240494:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789048951.240509:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789048951.240523:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789048951.240537:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789048951.240567:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789048951.240584:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789048951.240597:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789048951.240610:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789048951.240622:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789048951.240634:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789048951.240647:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789048951.240805:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789048951.240823:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789048951.240836:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789048951.240850:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789048951.240864:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789048951.240877:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789048951.240902:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789048951.240917:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789048951.240930:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789048951.240956:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789048951.240970:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789048951.240982:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789048951.241034:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111534208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.241111:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.241153:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534208 00000100:00100000:0.0:1789048951.241161:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534208 00000100:00100000:0.0:1789048951.241207:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789048951.241215:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111534208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.241365:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111534208:12345-0@lo:502:mount.lustre.0 Request processed in 149us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.241373:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789048951.241436:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.241458:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111534208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048951.241620:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789048951.241643:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789048951.241662:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111534336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.241692:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.241713:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534336 00000100:00100000:0.0:1789048951.241716:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534336 00000100:00100000:0.0:1789048951.241735:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789048951.241741:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111534336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789048951.241811:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111534336:12345-0@lo:502:mount.lustre.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.241827:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789048951.241855:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3eb696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.241867:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111534336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789048951.241899:0:25023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789048951.241906:0:25023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789048951.247025:0:25037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789048951.247059:0:25037:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff959b05e999c0) 00000020:00000080:1.0:1789048951.247087:0:25037:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1789048951.247176:0:25037:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3e9b8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789048951.247181:0:25037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c3e9b8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789048951.247184:0:25037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3e9b8000 3 00010000:00080000:1.0:1789048951.247217:0:25037:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959c064ac000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048951.250172:0:25037:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1789048951.250401:0:25037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789048951.250540:0:25037:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789048951.250554:0:25037:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x133f221c08777c23 00000100:00080000:1.0:1789048951.250564:0:25037:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048951.250576:0:25037:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff959c064ac000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048951.250613:0:25037:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd0380 x1875953111534464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048951.250640:0:25037:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789048951.250686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048951.250690:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048951.250692:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048951.250696:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1789048951.250699:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789048951.250709:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048951.250721:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd0e00 x1875953111534848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048951.250778:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048951.250781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048951.250783:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048951.250787:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 703 00000100:00080000:1.0:1789048951.250789:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789048951.250794:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048951.250805:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd2a00 x1875953111535360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789048951.250846:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111535104:0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.250909:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048951.250940:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111535744:0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.250968:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048951.250988:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789048951.250992:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111534976:0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.251013:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048951.251036:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111535616:0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.251069:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048951.251101:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535744 00000100:00100000:1.0:1789048951.251108:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535744 00000100:00100000:1.0:1789048951.251148:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534976 00000100:00100000:1.0:1789048951.251151:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534976 00000100:00100000:1.0:1789048951.251162:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535616 00000100:00100000:1.0:1789048951.251165:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535616 00000100:00100000:1.0:1789048951.251190:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048951.251198:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111535744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.251251:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111535744:12345-0@lo:400:kworker.0 Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048951.251257:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048951.251272:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048951.251278:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111534976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.251303:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111534976:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048951.251309:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048951.251320:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048951.251325:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111535616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048951.251370:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111535616:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048951.251376:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789048951.251410:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd1880 x1875953111534976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048951.251422:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111534976:0@lo:400:kworker.0 00010000:00080000:1.0:1789048951.251431:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd0000 x1875953111535616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048951.251439:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111535616:0@lo:400:kworker.0 00010000:00080000:1.0:1789048951.251447:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322c9f80 x1875953111535744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048951.251454:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111535744:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.251561:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111534464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789048951.251594:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.251627:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111534848:0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.251650:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.251668:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111535360:0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.251686:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.251717:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535104 00000100:00100000:2.0:1789048951.251721:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535104 00000100:00100000:2.0:1789048951.251764:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048951.251770:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111535104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.251807:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111535104:12345-0@lo:400:kworker.0 Request processed in 37us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.251812:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048951.251830:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534848 00000100:00100000:2.0:1789048951.251833:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534848 00000100:00100000:2.0:1789048951.251848:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535360 00000100:00100000:2.0:1789048951.251851:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535360 00000100:00100000:2.0:1789048951.251859:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048951.251864:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111534848:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.251904:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111534848:12345-0@lo:8:kworker.0 Request processed in 38us (252us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048951.251916:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048951.251928:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048951.251931:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111535360:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.251959:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111535360:12345-0@lo:8:kworker.0 Request processed in 26us (272us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048951.251964:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048951.251988:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048951.251995:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048951.251998:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789048951.252001:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111534848:0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.252009:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048951.252012:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048951.252014:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789048951.252017:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111535360:0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.252040:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111535104:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252143:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534464 00000100:00100000:2.0:1789048951.252148:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534464 00000100:00100000:2.0:1789048951.252167:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048951.252172:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1875953111534464:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789048951.252186:0:22705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:2.0:1789048951.252218:0:22705:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x133f221c08777c2a 00000004:00100000:2.0:1789048951.252232:0:22705:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789048951.252260:0:22705:0:(import.c:65:import_set_state_nolock()) ffff959b080ca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048951.252296:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875953111534464:12345-0@lo:38:llog_process_th.0 Request processed in 123us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.252310:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048951.252329:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111534720:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252408:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.252427:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111535488:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252447:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.252465:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789048951.252471:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111534592:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252492:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.252507:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111535232:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252526:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.252550:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535488 00000100:00100000:2.0:1789048951.252554:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535488 00000100:00100000:2.0:1789048951.252574:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789048951.252580:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111535488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252613:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111535488:12345-0@lo:400:kworker.0 Request processed in 33us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.252619:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789048951.252642:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd0380 x1875953111534464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048951.252651:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789048951.252656:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789048951.252664:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789048951.252668:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789048951.252670:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c064ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789048951.252675:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3619:1875953111534464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789048951.252701:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534720 00000100:00100000:2.0:1789048951.252704:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534720 00000100:00100000:2.0:1789048951.252723:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535232 00000100:00100000:2.0:1789048951.252725:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535232 00000100:00100000:2.0:1789048951.252769:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048951.252777:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111534720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252806:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111534720:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.252812:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789048951.252822:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789048951.252827:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111535232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.252851:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111535232:12345-0@lo:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.252856:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789048951.252944:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789048951.252948:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789048951.252950:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048951.252978:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111534592 00000100:00100000:2.0:1789048951.252982:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111534592 00000100:00100000:2.0:1789048951.253004:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048951.253011:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111534592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.253041:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111534592:12345-0@lo:400:kworker.0 Request processed in 31us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.253047:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048951.253073:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111534592:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.253083:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111535232:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.253104:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111534720:0@lo:400:kworker.0 00010000:00080000:2.0:1789048951.253112:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd1180 x1875953111535488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048951.253120:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111535488:0@lo:400:kworker.0 00000020:01000004:1.0:1789048951.256808:0:25037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789048951.256837:0:25037:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff959b05e98000) 00000020:00000080:1.0:1789048951.256870:0:25037:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1789048951.256984:0:25037:0:(tgt_mount.c:153:server_get_mount()) get mount ffff959c3e9b8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789048951.256989:0:25037:0:(tgt_mount.c:187:server_put_mount()) put mount ffff959c3e9b8000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789048951.256992:0:25037:0:(obd_mount.c:710:lustre_put_lsi()) put ffff959c3e9b8000 3 00010000:00080000:1.0:1789048951.257026:0:25037:0:(ldlm_lib.c:102:import_set_conn()) imp ffff959b076c3800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789048951.259499:0:25037:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789048951.259725:0:25037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789048951.259778:0:25037:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789048951.259792:0:25037:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x133f221c08777c38 00000100:00080000:1.0:1789048951.259803:0:25037:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789048951.259815:0:25037:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff959b076c3800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048951.259852:0:25037:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c322c9f80 x1875953111535872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048951.259873:0:25037:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789048951.259922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048951.259925:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048951.259927:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048951.259934:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048951.259946:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c322cb100 x1875953111536128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789048951.259972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789048951.259975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789048951.259977:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789048951.259981:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789048951.259997:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959c3fcd1180 x1875953111536512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048951.263468:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111536256:0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.263543:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263578:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111536896:0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.263603:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263626:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789048951.263633:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d3f2942-6380-4c90-a339-b9cf9971a742:3623:1875953111536000:0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.263683:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263716:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111536768:0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.263737:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263781:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111535872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789048951.263806:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263817:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111536128:0@lo:8:kworker.0 00000100:00100000:3.0:1789048951.263842:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263859:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111536512:0@lo:8:kworker.0 00000100:00100000:3.0:1789048951.263877:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.263907:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536256 00000100:00100000:3.0:1789048951.263914:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536256 00000100:00100000:3.0:1789048951.263949:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536896 00000100:00100000:3.0:1789048951.263951:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536896 00000100:00100000:3.0:1789048951.263974:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536768 00000100:00100000:3.0:1789048951.263977:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536768 00000100:00100000:3.0:1789048951.264004:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111535872 00000100:00100000:3.0:1789048951.264007:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111535872 00000100:00100000:3.0:1789048951.264021:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789048951.264030:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111536256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.264082:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111536256:12345-0@lo:400:kworker.0 Request processed in 53us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048951.264088:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789048951.264104:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048951.264111:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111536896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.264138:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111536896:12345-0@lo:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048951.264153:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789048951.264167:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048951.264173:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111536768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048951.264201:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111536768:12345-0@lo:400:kworker.0 Request processed in 29us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048951.264738:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048951.264764:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048951.264769:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1875953111535872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789048951.264793:0:22704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 706 last 0 00000020:00000080:3.0:1789048951.264827:0:22704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x133f221c08777c3f 00000004:00100000:3.0:1789048951.264843:0:22704:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789048951.264876:0:22704:0:(import.c:65:import_set_state_nolock()) ffff959c3c4a8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789048951.264923:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875953111535872:12345-0@lo:38:llog_process_th.0 Request processed in 153us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048951.264929:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789048951.264970:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd1f80 x1875953111536768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048951.264983:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111536768:0@lo:400:kworker.0 00010000:00080000:3.0:1789048951.264993:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322c9880 x1875953111536256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048951.265000:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111536256:0@lo:400:kworker.0 00010000:00080000:3.0:1789048951.265009:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd2680 x1875953111536896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048951.265028:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111536896:0@lo:400:kworker.0 00010000:00080000:3.0:1789048951.265065:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c322c9f80 x1875953111535872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789048961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048951.265074:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789048951.265081:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789048951.265089:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789048951.265094:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789048951.265096:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959b076c3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789048951.265100:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3619:1875953111535872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789048951.266560:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111536384:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.266619:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.266665:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048951.266672:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111536640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.266696:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.266852:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536640 00000100:00100000:2.0:1789048951.266860:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536640 00000100:00100000:2.0:1789048951.266897:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048951.266906:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111536640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.266955:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111536640:12345-0@lo:400:kworker.0 Request processed in 50us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.266962:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048951.266989:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536128 00000100:00100000:2.0:1789048951.266992:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536128 00000100:00100000:2.0:1789048951.267008:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536512 00000100:00100000:2.0:1789048951.267011:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536512 00000100:00100000:2.0:1789048951.267021:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048951.267025:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111536128:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.267074:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111536128:12345-0@lo:8:kworker.0 Request processed in 47us (3230us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048951.267082:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048951.267093:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048951.267105:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111536512:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789048951.267137:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3619:x1875953111536512:12345-0@lo:8:kworker.0 Request processed in 31us (3258us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789048951.267141:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789048951.267160:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048951.267170:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536384 00000100:00100000:2.0:1789048951.267174:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536384 00000100:00100000:2.0:1789048951.267197:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789048951.267203:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111536384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.267233:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111536384:12345-0@lo:400:kworker.0 Request processed in 30us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.267239:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789048951.267272:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff959c3fcd3b80 x1875953111536640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048951.267284:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111536640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048951.267294:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111536384:0@lo:400:kworker.0 00000100:00080000:2.0:1789048951.267325:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048951.267329:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789048951.267356:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111536128:0@lo:8:kworker.0 00000100:00080000:2.0:1789048951.267367:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789048951.267370:0:3619:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789048951.267373:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111536512:0@lo:8:kworker.0 00000100:00100000:0.0:1789048951.267585:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111536000 00000100:00100000:0.0:1789048951.267591:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111536000 00000100:00100000:0.0:1789048951.267619:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789048951.267626:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3623:x1875953111536000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048951.267678:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3623:x1875953111536000:12345-0@lo:400:kworker.0 Request processed in 52us (3993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.267684:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000040:00080000:1.0:1789048951.270839:0:25037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1789048951.270984:0:25023:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789048951.271014:0:25023:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789048951.271141:0:25023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c15 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.271152:0:25023:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07061600/0x133f221c08777c0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c15 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789048951.271200:0:25023:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789048951.271202:0:25023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048951.271203:0:25023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048951.271204:0:25023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048951.271206:0:25023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048951.271207:0:25023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048951.271208:0:25023:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048951.271210:0:25023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048951.271211:0:25023:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789048951.271215:0:25023:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789048951.271222:0:25023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789048951.271223:0:25023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789048951.271224:0:25023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789048951.271225:0:25023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789048951.271226:0:25023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789048951.271227:0:25023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789048951.271228:0:25023:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789048951.271229:0:25023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789048951.271230:0:25023:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789048951.271604:0:25023:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789048951.271626:0:25023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111537024:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789048951.271685:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d3f2942-6380-4c90-a339-b9cf9971a742:3623:1875953111536000:0@lo:400:kworker.0 00000100:00100000:0.0:1789048951.277088:0:25023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048951.277131:0:25023:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c39540e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789048951.277314:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537024 00000100:00100000:1.0:1789048951.277324:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537024 00000100:00100000:1.0:1789048951.277423:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789048951.277433:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111537024:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789048951.277465:0:22699:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789048951.277479:0:22699:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789048951.289957:0:22699:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789048951.289971:0:22699:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789048951.290542:0:22720:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789048951.290553:0:22720:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789048951.290576:0:22720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.290596:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777acc expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.290604:0:22720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777ada expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.290610:0:22720:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.290647:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777ada expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.290667:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777ada expref: 24 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048951.290681:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111537152:0@lo:104: 00000100:00100000:2.0:1789048951.290743:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048951.290945:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:25023:x1875953111537024:12345-0@lo:253:mount.lustre.0 Request processed in 13512us (13861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048951.290955:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789048951.291013:0:25023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2d3f2942-6380-4c90-a339-b9cf9971a742:25023:1875953111537024:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789048951.291026:0:25023:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789048951.291029:0:25023:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789048951.291030:0:25023:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789048951.291031:0:25023:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789048951.291033:0:25023:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789048951.291034:0:25023:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789048951.291035:0:25023:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789048951.291036:0:25023:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789048951.291039:0:25023:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789048951.291040:0:25023:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789048951.291054:0:25023:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789048951.291446:0:22720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777acc expref: 23 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.291457:0:22720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777acc expref: 23 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048951.291467:0:22720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111537280:0@lo:104: 00000100:00100000:2.0:1789048951.291492:0:22720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.291519:0:22720:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048951.291521:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537152 00000100:00100000:0.0:1789048951.291527:0:22687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537152 00000100:00100000:0.0:1789048951.291556:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537280 00000100:00100000:0.0:1789048951.291559:0:22687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537280 00000100:00100000:0.0:1789048951.291571:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048951.291578:0:22687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+4:22720:x1875953111537152:12345-0@lo:104: 00010000:00010000:0.0:1789048951.291590:0:22687:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291636:0:22687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789048951.291641:0:22687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+4:22720:x1875953111537152:12345-0@lo:104: Request processed in 64us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.291647:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048951.291659:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789048951.291664:0:22687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111537280:12345-0@lo:104: 00010000:00010000:0.0:1789048951.291672:0:22687:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291701:0:22687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789048951.291715:0:22687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2d3f2942-6380-4c90-a339-b9cf9971a742+3:22720:x1875953111537280:12345-0@lo:104: Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.291720:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789048951.291739:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789048951.291756:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291764:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048951.291768:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291776:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048951.291783:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048951.291788:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048951.291825:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291832:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048951.291852:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291859:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777ada lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777ae1 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291870:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048951.291873:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291889:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048951.291892:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291899:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048951.291905:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048951.291910:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789048951.291924:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291930:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048951.291936:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291942:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777acc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777ad3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.291955:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048951.291957:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048951.291959:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048951.291966:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048951.295880:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111537408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048951.295972:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.296028:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048951.296034:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111537536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789048951.296056:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048951.297866:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111537152:0@lo:104: 00000100:00100000:2.0:1789048951.297888:0:22720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22720:1875953111537280:0@lo:104: 00010000:00010000:2.0:1789048951.297913:0:22720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.298602:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537408 00000100:00100000:0.0:1789048951.298610:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537408 00010000:00010000:0.0:1789048951.298643:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777ada expref: 24 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.298776:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537536 00000100:00100000:0.0:1789048951.298781:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537536 00010000:00010000:0.0:1789048951.298794:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777acc expref: 25 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.298814:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789048951.298822:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d3f2942-6380-4c90-a339-b9cf9971a742+25:3620:x1875953111537408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048951.298837:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048951.298843:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777ada expref: 25 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.298859:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777ada expref: 25 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.298875:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef3c800/0x133f221c08777ae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777ada expref: 25 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048951.298877:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789048951.298887:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3620:x1875953111537536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048951.298889:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048951.298895:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048951.298899:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777acc expref: 24 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298909:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777acc expref: 24 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298917:0:24236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba0e00/0x133f221c08777ad3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777acc expref: 24 pid: 22697 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298927:0:24236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298934:0:24236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789048951.298949:0:24236:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015656362s 00010000:00010000:2.0:1789048951.298954:0:24236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048951.298955:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:3620:x1875953111537408:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (2984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048951.298962:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789048951.298966:0:24236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298973:0:24236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298980:0:24236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298986:0:24236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048951.298991:0:24236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.298999:0:24236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.299021:0:24236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048951.299031:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048951.299056:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+22:3620:x1875953111537536:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048951.299062:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789048951.299105:0:22720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048951.299113:0:22720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048951.299118:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111537536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048951.299119:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1400/0x133f221c08777c46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048951.299134:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d313b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111537408:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1789048951.302040:0:25023:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789048951.305936:0:25023:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789048951.305945:0:25023:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789048951.305985:0:25023:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789048951.306044:0:25023:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789048951.306065:0:25023:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789048951.306084:0:25023:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789048951.307081:0:25023:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048951.307391:0:25023:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789048951.391838:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789048951.454134:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048952.487557:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048952.492583:0:25091:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048952.492856:0:25091:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789048952.933790:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789048952.933801:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c3fcc0000 from 14 10000000:01000000:1.0:1789048952.933808:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789048952.933879:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048952.933895:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048952.933909:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048952.933945:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111537664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789048952.934040:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048952.934093:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048952.934124:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537664 00000100:00100000:1.0:1789048952.934132:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537664 00000100:00100000:1.0:1789048952.934197:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789048952.934208:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111537664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048952.934227:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048952.934251:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c07061800/0x133f221c08777c54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777c4d expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048952.934283:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c07061800/0x133f221c08777c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777c4d expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048952.934296:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c07061800/0x133f221c08777c54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777c4d expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048952.934306:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061800, rc 0) 00000100:00100000:1.0:1789048952.934375:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111537664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048952.934382:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789048952.934445:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111537664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048952.934463:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c54 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048952.934472:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777c54 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048952.934527:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111537792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789048952.934560:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048952.934674:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c115ed300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048952.936377:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537792 00000100:00100000:2.0:1789048952.936392:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537792 00000100:00100000:2.0:1789048952.936468:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789048952.936481:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111537792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789048952.936512:0:22699:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789048952.936544:0:22699:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789048952.936547:0:22699:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789048952.939814:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111537792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3322us (5238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048952.939832:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789048952.939936:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111537792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789048952.940035:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789048952.940049:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c54 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.940063:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c07060600/0x133f221c08777c4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c54 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048952.940077:0:22701:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789048952.940080:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff959c2e493000 from 14 10000000:01000000:2.0:1789048952.940083:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789048952.940126:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.940134:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.940143:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048952.940169:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111537920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048952.940212:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048952.940254:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c32f3e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789048952.940274:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111537920 00000100:00100000:2.0:1789048952.940290:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111537920 00000100:00100000:2.0:1789048952.940503:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789048952.940517:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111537920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048952.940534:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048952.940550:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0e00/0x133f221c08777c62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777c5b expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.941123:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0e00/0x133f221c08777c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777c5b expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.941142:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0e00/0x133f221c08777c62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777c5b expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.941153:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0e00, rc 0) 00000100:00100000:2.0:1789048952.941214:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111537920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 701us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048952.941223:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789048952.942914:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111537920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048952.942949:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c62 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048952.942963:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777c62 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048952.943047:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111538048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789048952.943114:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048952.943164:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2aca5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048952.943768:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538048 00000100:00100000:2.0:1789048952.943778:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538048 00000100:00100000:2.0:1789048952.943831:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789048952.943841:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111538048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789048952.943866:0:22696:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789048952.943886:0:22696:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789048952.943890:0:22696:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1789048952.943979:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111538048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048952.943988:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789048952.944033:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111538048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789048952.944099:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789048952.944108:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c62 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048952.944119:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1c00/0x133f221c08777c5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777c62 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048953.502744:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048954.335208:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048954.335243:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111538176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048954.335366:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048954.335442:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538176 00000100:00100000:3.0:1789048954.335454:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538176 00000100:00100000:3.0:1789048954.335542:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789048954.335555:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111538176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048954.335598:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789048954.337044:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048954.337078:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111538304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048954.337161:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048954.337225:0:24213:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789048954.337236:0:24213:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789048954.337712:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538304 00000100:00100000:1.0:1789048954.337731:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538304 00000100:00080000:1.0:1789048954.337788:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048954.337993:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789048954.338006:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111538304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048954.338031:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048954.338109:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111538304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048954.338116:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789048954.338279:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111538304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048954.341625:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111538176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6064us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048954.341644:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048954.341804:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111538176:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789048954.533089:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048955.357771:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111538432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048955.357889:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048955.358181:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538432 00000100:00100000:0.0:1789048955.358195:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538432 00000100:00100000:0.0:1789048955.358277:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789048955.358290:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111538432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789048955.358364:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789048955.358429:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111538432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048955.358454:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789048955.358573:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111538560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789048955.358626:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048955.358779:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538560 00000100:00100000:0.0:1789048955.358784:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538560 00000100:00100000:0.0:1789048955.358815:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789048955.358820:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111538560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789048955.358844:0:22710:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789048955.358889:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111538560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048955.358896:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789048955.359075:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111538560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048955.359843:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111538432:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789048955.550397:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048956.062539:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1789048956.382823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048956.382833:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048956.382837:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048956.382859:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff959c3e9d9800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048956.382890:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08847800 x1875953111539072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789048956.382930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789048956.382934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789048956.382947:0:37:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789048956.382954:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff959c3fb93800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789048956.382968:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff959b08844a80 x1875953111539584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789048956.383047:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111538944:0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.384238:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111539200:0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.384382:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.384428:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111539840:0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.384454:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048956.384620:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.384817:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111538688:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.384865:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.384896:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111539072:0@lo:8:kworker.0 00000100:00100000:3.0:1789048956.388753:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111539712:0@lo:400:kworker.0 00000100:00100000:3.0:1789048956.388839:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048956.388865:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111540224:0@lo:400:kworker.0 00000100:00100000:3.0:1789048956.388887:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.392740:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111539328:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.392826:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.392862:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111539968:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.392889:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.392917:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789048956.392925:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111538816:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.392953:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.392987:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111539456:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.393015:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.393052:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111540096:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.393092:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.393137:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538944 00000100:00100000:1.0:1789048956.393146:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538944 00000100:00100000:1.0:1789048956.393210:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539456 00000100:00100000:1.0:1789048956.393214:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539456 00000100:00100000:1.0:1789048956.393234:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048956.393244:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111538944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.393310:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111538944:12345-0@lo:400:kworker.0 Request processed in 67us (8690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048956.393317:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789048956.393357:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789048956.393364:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111539456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.393394:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111539456:12345-0@lo:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048956.393412:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789048956.393430:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048956.393556:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111538944:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.393588:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111539456:0@lo:400:kworker.0 00000100:00100000:3.0:1789048956.394236:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539328 00000100:00100000:3.0:1789048956.394244:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539328 00000100:00100000:3.0:1789048956.394280:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538816 00000100:00100000:3.0:1789048956.394284:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538816 00000100:00100000:3.0:1789048956.394301:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048956.394309:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048956.394401:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111539328:12345-0@lo:400:kworker.0 Request processed in 93us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048956.394408:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048956.394423:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048956.394429:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111538816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048956.394455:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111538816:12345-0@lo:400:kworker.0 Request processed in 27us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048956.394460:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789048956.395966:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111538816:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.395988:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111539328:0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.402330:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539200 00000100:00100000:2.0:1789048956.402368:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539200 00000100:00100000:2.0:1789048956.402430:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539840 00000100:00100000:2.0:1789048956.402433:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539840 00000100:00100000:2.0:1789048956.402457:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539712 00000100:00100000:2.0:1789048956.402460:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539712 00000100:00100000:2.0:1789048956.402474:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540224 00000100:00100000:2.0:1789048956.402477:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540224 00000100:00100000:2.0:1789048956.402492:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539968 00000100:00100000:2.0:1789048956.402495:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539968 00000100:00100000:2.0:1789048956.402507:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540096 00000100:00100000:2.0:1789048956.402510:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540096 00000100:00100000:2.0:1789048956.402532:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048956.402543:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111539200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.402670:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111539200:12345-0@lo:400:kworker.0 Request processed in 128us (18288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.402678:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048956.402710:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048956.402718:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111539840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.402885:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111539840:12345-0@lo:400:kworker.0 Request processed in 167us (18429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.402892:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789048956.402906:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048956.402912:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111539712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.403021:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111539712:12345-0@lo:400:kworker.0 Request processed in 109us (14183us total) trans 0 rc 0/0 00000100:00080000:1.0:1789048956.403189:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789048956.403196:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789048956.404163:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08847480 x1875953111539200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048956.404185:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111539200:0@lo:400:kworker.0 00010000:00080000:1.0:1789048956.404200:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08846300 x1875953111539840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048956.404209:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111539840:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.404261:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111538688 00000100:00100000:1.0:1789048956.404269:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111538688 00000100:00100000:1.0:1789048956.404323:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789048956.404346:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3622:x1875953111538688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.404420:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3622:x1875953111538688:12345-0@lo:400:kworker.0 Request processed in 89us (19553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048956.404427:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789048956.404466:0:22704:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789048956.404476:0:22704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:1.0:1789048956.404537:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08847b80 x1875953111539712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048956.404548:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111539712:0@lo:400:kworker.0 00000100:00100000:1.0:1789048956.404575:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c322c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111538688:0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.404856:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789048956.404879:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789048956.404890:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111540224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.405165:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111540224:12345-0@lo:400:kworker.0 Request processed in 279us (16276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.405173:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789048956.405188:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048956.405196:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111539968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.405240:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875953111539968:12345-0@lo:400:kworker.0 Request processed in 46us (12350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.405246:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789048956.405259:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789048956.405616:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111540096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.405658:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111540096:12345-0@lo:400:kworker.0 Request processed in 47us (12566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.405663:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789048956.405731:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08847100 x1875953111540096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048956.405745:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111540096:0@lo:400:kworker.0 00010000:00080000:2.0:1789048956.405759:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08846d80 x1875953111539968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048956.405767:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3622:1875953111539968:0@lo:400:kworker.0 00000100:00100000:2.0:1789048956.405814:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.405852:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539072 00000100:00100000:2.0:1789048956.405858:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539072 00000100:00100000:2.0:1789048956.405885:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048956.405890:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3619:x1875953111539072:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789048956.405923:0:24209:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:2.0:1789048956.405975:0:24209:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x133f221c08777c69 00002000:00100000:2.0:1789048956.405993:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff959b080cf800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789048956.405998:0:24209:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789048956.406001:0:24209:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:1.0:1789048956.407036:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08846680 x1875953111540224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048956.407052:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111540224:0@lo:400:kworker.0 00002000:00080000:2.0:1789048956.408409:0:24209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789048956.408453:0:24209:0:(import.c:65:import_set_state_nolock()) ffff959b080ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048956.408551:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875953111539072:12345-0@lo:8:kworker.0 Request processed in 2657us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.408562:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789048956.408654:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08847800 x1875953111539072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789048956.408672:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789048956.408683:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789048956.408690:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789048956.408693:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3e9d9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789048956.409166:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789048956.409177:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3619:1875953111539072:0@lo:8:kworker.0 00000004:00080000:2.0:1789048956.409252:0:22731:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789048956.409278:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1875953111540480:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789048956.409373:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.409396:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c19e4da80 going to sleep for 11 seconds 00000004:00080000:2.0:1789048956.409414:0:22730:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789048956.409517:0:22730:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 711163182974ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789048956.409525:0:22730:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789048956.409552:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048956.409565:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111540352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048956.409598:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048956.410904:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540480 00000100:00100000:1.0:1789048956.410920:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540480 00000100:00100000:1.0:1789048956.411006:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789048956.411019:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22731:x1875953111540480:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1789048956.411350:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048956.414019:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540352 00000100:00100000:2.0:1789048956.414046:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540352 00000100:00100000:2.0:1789048956.414110:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048956.414120:0:24213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111540352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789048956.414160:0:24213:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789048956.414262:0:24213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111540352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (4663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.414270:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789048956.414348:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3958ed80 x1875953111540352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048956.414374:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111540352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048956.414434:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111539584:0@lo:8:kworker.0 00000100:00100000:2.0:1789048956.414476:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.414505:0:24210:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789048956.414514:0:24210:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1789048956.417278:0:24211:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789048956.417293:0:24211:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1789048956.417300:0:24211:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000100:00100000:3.0:1789048956.425451:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111539584 00000100:00100000:3.0:1789048956.425472:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111539584 00000100:00100000:0.0:1789048956.429238:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789048956.429258:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3619:x1875953111539584:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789048956.429307:0:25242:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:0.0:1789048956.429374:0:25242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x133f221c08777c70 00002000:00100000:0.0:1789048956.429395:0:25242:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff959b0838d800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789048956.429400:0:25242:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789048956.429403:0:25242:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789048956.429505:0:25242:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789048956.429540:0:25242:0:(import.c:65:import_set_state_nolock()) ffff959b0838b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048956.429665:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3619:x1875953111539584:12345-0@lo:8:kworker.0 Request processed in 408us (15187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048956.429673:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789048956.429990:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b08844a80 x1875953111539584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789048981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789048956.430013:0:3619:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789048956.430035:0:3619:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789048956.430042:0:3619:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789048956.430045:0:3619:0:(import.c:65:import_set_state_nolock()) ffff959c3fb93800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789048956.430071:0:3619:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789048956.430078:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3619:1875953111539584:0@lo:8:kworker.0 00000004:00080000:0.0:1789048956.432191:0:23448:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789048956.432247:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1875953111540736:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789048956.432351:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048956.432395:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c012ed540 going to sleep for 11 seconds 00000100:00100000:0.0:1789048956.432442:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048956.432457:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111540608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048956.432491:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048956.432532:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540736 00000100:00100000:0.0:1789048956.432541:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540736 00000100:00100000:0.0:1789048956.432614:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789048956.432624:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23448:x1875953111540736:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789048956.434411:0:23447:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789048956.434545:0:23447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 711188211600ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789048956.434555:0:23447:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789048956.436133:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540608 00000100:00100000:2.0:1789048956.436164:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540608 00000100:00100000:2.0:1789048956.436236:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048956.436249:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1875953111540608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789048956.436283:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789048956.436419:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1875953111540608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 173us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048956.436427:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789048956.436492:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3d310a80 x1875953111540608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789048972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048956.436521:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111540608:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789048956.437002:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789048956.444485:0:22684:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1789048956.444651:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048956.444665:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.444690:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789048956.444708:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048956.444717:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.444758:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.444770:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.444779:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.444817:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.445455:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.445465:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.445477:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.445483:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.445495:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.445517:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.445525:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777c77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.445551:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.445552:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.445554:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789048956.451079:0:23437:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789048956.455593:0:24210:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789048956.455611:0:24210:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789048956.455782:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23448:x1875953111540736:12345-0@lo:7:osp-pre-1-1.0 Request processed in 23152us (23424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048956.455796:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789048956.456093:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1875953111540736:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789048956.456113:0:23448:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789048956.456165:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1875953111540864:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789048956.456212:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048956.456258:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048956.456442:0:25242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540864 00000100:00100000:3.0:1789048956.456451:0:25242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540864 00000100:00100000:3.0:1789048956.456510:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048956.456521:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1875953111540864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789048956.456556:0:25242:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1789048956.456593:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23448:x1875953111540864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 74us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048956.456601:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789048956.456665:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1875953111540864:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789048956.456676:0:23448:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789048956.456720:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1875953111540992:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789048956.457106:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048956.457133:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c3e87e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048956.457459:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111540992 00000100:00100000:3.0:1789048956.457464:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111540992 00000100:00100000:3.0:1789048956.457504:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048956.457513:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23448:x1875953111540992:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789048956.457571:0:24210:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:1.0:1789048956.460937:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.460954:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.460979:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.460985:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.460993:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.461015:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.461027:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.461045:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.461079:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048956.461108:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048956.461118:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.461127:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cc200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048956.461133:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.461155:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.461180:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.461188:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd9f89da/0x133f221c08777c7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.461211:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048956.461213:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048956.461215:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.461894:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.461903:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.461917:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.461922:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.462355:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.462371:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.462380:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.462388:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.462408:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.462984:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.462994:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.463005:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cd200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.463018:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.463040:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.463062:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.463070:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c457548/0x133f221c08777c85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.463097:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.463099:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.463101:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.464440:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.464454:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.464482:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.464487:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.464494:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.464508:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.464518:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.464527:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.464554:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048956.464574:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048956.464583:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.464592:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cd000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048956.464597:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.464606:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.464628:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.464636:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541045d6/0x133f221c08777c8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.464657:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.464658:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.464660:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.466191:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.466204:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.466223:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.467114:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.467128:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.467148:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.467173:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.467183:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.467213:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.467266:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.467275:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.467284:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cda00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.467289:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.467301:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.467321:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.467358:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a7c38c/0x133f221c08777c93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.467386:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.467388:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.467390:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.467995:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.468004:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468016:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.468020:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.468026:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468037:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468045:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468053:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468087:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048956.468116:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048956.468124:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.468132:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cca00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048956.468136:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.468152:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.468167:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.468175:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a81bc47/0x133f221c08777c9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.468193:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.468195:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.468197:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.468776:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.468784:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468796:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.468800:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.468805:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468816:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468825:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468834:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.468858:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.468931:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.468938:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.468947:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c420cc000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.468950:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.468958:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.468971:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.468979:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e8db0ed/0x133f221c08777ca1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.468996:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.468998:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.469000:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.470693:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.470718:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.470737:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.470757:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.470765:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.470781:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.470792:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.470801:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.470826:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048956.470998:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048956.471007:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.471016:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048956.471021:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.471042:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.471063:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.471084:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe4b9b2/0x133f221c08777ca8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.471107:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.471109:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.471111:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.471379:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.471384:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.471394:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.471397:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.471402:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.471412:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.471419:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.471434:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.471456:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048956.472163:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048956.472172:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.472183:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048956.472188:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.472197:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.472216:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.472225:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006868f2d8/0x133f221c08777caf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.472247:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.472249:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.472251:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.473891:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.473908:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.473932:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.473937:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.473944:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.473962:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.473972:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.473981:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.474006:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789048956.474348:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789048956.474359:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.474369:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:3.0:1789048956.474375:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.474386:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.474410:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.474417:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005947dc6/0x133f221c08777cb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.474443:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.474445:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.474447:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789048956.481456:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789048956.481473:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.481493:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=711s v=(0 0) 00010000:00010000:2.0:1789048956.481499:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048956.481506:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.481524:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.481537:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.481546:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.481572:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789048956.481999:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789048956.482010:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482020:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048956.482035:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482046:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482066:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482086:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002737cdda/0x133f221c08777cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482113:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048956.482115:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048956.482117:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048956.482422:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048956.482428:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482440:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789048956.482445:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048956.482450:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482462:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482470:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482478:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.482496:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.483035:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.483044:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.483053:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.483057:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.483077:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.483094:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.483101:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075ab6520/0x133f221c08777cc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.483119:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.483121:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.483122:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789048956.483329:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789048956.483418:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.483430:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=711s v=(0 0) 00010000:00010000:0.0:1789048956.483435:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048956.483441:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.483456:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.483466:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.483474:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048956.483534:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.490029:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.490049:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.490067:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.490075:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.490090:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.490130:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.490158:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3a68e6c/0x133f221c08777ccb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.490183:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.490185:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.490187:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.491486:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.491502:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.491527:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.491532:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.491540:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.491555:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.491566:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.491574:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.491611:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.492152:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.492161:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492172:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.492178:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492187:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492207:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492215:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dffa817e/0x133f221c08777cd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492234:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.492236:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.492238:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789048956.492361:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789048956.492367:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.492376:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=711s v=(0 0) 00010000:00010000:1.0:1789048956.492380:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048956.492385:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.492394:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.492411:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.492419:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.492435:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.492824:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.492831:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492840:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08365e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.492844:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492853:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048956.492898:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.492906:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.492916:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.492920:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048956.492941:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492950:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3c53ae3/0x133f221c08777cd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.492965:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.492967:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.492969:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048956.493054:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493079:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493089:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493097:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493116:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.493176:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.493182:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493190:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.493193:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493211:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493223:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493230:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae2528a3/0x133f221c08777ce0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493244:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.493245:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.493247:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.493634:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.493640:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493649:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.493653:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.493657:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493666:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493673:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493691:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.493721:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.493750:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.493754:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493762:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.493766:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493775:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493787:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493805:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029f7b11c/0x133f221c08777ce7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.493820:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.493822:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.493823:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.495713:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.495727:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.495747:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.495753:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.495760:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.495775:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.495786:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.495795:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.495820:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.495849:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.495867:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.495876:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.495881:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.495890:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.495911:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.495919:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abd10f62/0x133f221c08777cee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.495936:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.495938:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.495939:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.496802:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.496815:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.496837:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.496841:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.496847:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.496860:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.496870:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.496879:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.496901:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.497041:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.497049:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.497058:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3dc00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.497063:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.497071:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.497087:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.497093:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff20c76b/0x133f221c08777cf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.497109:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.497110:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.497112:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.498043:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.498052:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498068:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.498073:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.498078:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498091:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498114:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498123:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498145:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.498486:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.498493:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498502:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.498506:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498527:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498544:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498552:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fabbd379/0x133f221c08777cfc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498573:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.498574:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.498576:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.498804:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.498811:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498821:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.498825:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.498830:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498841:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498850:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498858:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.498893:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.498943:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.498949:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498957:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3de00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.498960:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498968:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498979:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.498997:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3b016d8/0x133f221c08777d03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.499014:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.499016:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.499017:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.499465:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.499472:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.499483:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.499487:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.499492:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.499503:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.499510:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.499517:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.499537:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.499940:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.499946:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.499957:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.499961:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.499969:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.499986:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.499993:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029918e1e/0x133f221c08777d0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.500012:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.500014:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.500016:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.501004:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.501014:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.501151:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.501165:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.501171:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.501185:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.501194:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.501202:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.502714:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048956.507180:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.507200:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.507223:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.507229:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.507238:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.507256:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.507269:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.507296:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.514415:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789048956.515579:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048956.515595:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.515623:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3c200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.515629:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.515644:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.515674:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.515683:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ba5a55/0x133f221c08777d11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.515718:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.515722:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048956.516040:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.516050:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.516065:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.516070:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.516078:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.516093:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.516102:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.516111:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.516123:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789048956.516715:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060000 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.516721:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516741:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516895:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516903:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c08777d18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516927:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.516932:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516940:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.516943:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516951:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516960:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516967:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004889cf24/0x133f221c08777d1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.516981:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.516983:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.516993:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.517265:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.517273:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.517294:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.517299:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.517305:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.517318:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.517328:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.517374:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.517392:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048956.517983:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.517992:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518004:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.518008:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.518012:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518099:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518126:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518135:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518147:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789048956.518655:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.518663:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518674:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.518677:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.518682:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518693:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518715:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518723:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.518876:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789048956.519385:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789048956.519396:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519406:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.519412:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519423:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519444:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519453:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c08777d26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519479:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048956.519483:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519489:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836800 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.519493:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519500:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519520:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519528:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000966a80c7/0x133f221c08777d2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519542:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.519546:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519552:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836e00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.519555:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519562:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519572:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519579:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049a5b040/0x133f221c08777d34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.519592:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.519594:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.519602:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048956.519866:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.520543:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.520553:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.520570:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.520575:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.520581:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.520594:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.520603:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.520612:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.520636:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789048956.521304:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.521312:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.521327:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.521369:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.521376:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.521389:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.521399:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.521408:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.521428:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789048956.521723:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789048956.521749:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521759:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.521764:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521774:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521794:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521803:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e75555b4/0x133f221c08777d3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521828:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789048956.521831:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521838:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837400 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:2.0:1789048956.521842:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.521849:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.522115:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.522123:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e22ab527/0x133f221c08777d42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048956.522140:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.522142:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048956.522144:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789048956.523241:0:24211:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789048956.523256:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.523274:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=711s v=(0 0) 00010000:00010000:3.0:1789048956.523280:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789048956.523287:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.523302:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.523314:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.523350:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048956.523375:0:24211:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789048956.523471:0:24211:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1789048956.523606:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22731:x1875953111540480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112585us (114228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048956.523618:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789048956.524987:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048956.525000:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.525015:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837a00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048956.525020:0:22692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.525044:0:22692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.525068:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.525078:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003db97bb/0x133f221c08777d49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048956.525124:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048956.525126:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048956.525128:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048956.525410:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1875953111540480:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789048956.525435:0:22731:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789048956.525508:0:22731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1875953111541120:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789048956.525584:0:22731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.525624:0:22731:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c08ae3840 going to sleep for 11 seconds 00010000:00010000:2.0:1789048956.525661:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789048956.526564:0:25024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1789048956.526610:0:25024:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789048956.526618:0:25024:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789048956.528389:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541120 00000100:00100000:1.0:1789048956.528407:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541120 00000100:00100000:1.0:1789048956.528592:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789048956.528605:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22731:x1875953111541120:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789048956.528669:0:24209:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1789048956.533244:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23448:x1875953111540992:12345-0@lo:5:osp-pre-1-1.0 Request processed in 75716us (76121us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789048956.533265:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789048956.533420:0:23448:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789048956.533432:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d311880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23448:1875953111540992:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789048956.533455:0:23448:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789048956.533537:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23448:1875953111541248:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789048956.533587:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048956.533627:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c08ae39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789048956.533709:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541248 00000100:00100000:3.0:1789048956.533718:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541248 00000100:00100000:3.0:1789048956.533788:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789048956.533799:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23448:x1875953111541248:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789048956.533853:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23448:x1875953111541248:12345-0@lo:900:osp-pre-1-1.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048956.534114:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789048956.534203:0:23448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610e00 x1875953111541248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789048972 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048956.534232:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23448:1875953111541248:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789048956.539771:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22731:x1875953111541120:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11158us (14177us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789048956.539787:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789048956.540132:0:22731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22731:1875953111541120:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789048956.540154:0:22731:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1789048956.573616:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048957.597585:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048958.633024:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048959.179090:0:25384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789048959.457240:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789048959.457321:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048959.457398:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111541504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048959.457426:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048959.464749:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541376 00000100:00100000:1.0:1789048959.464764:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541376 00000100:00100000:1.0:1789048959.464829:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541504 00000100:00100000:1.0:1789048959.464833:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541504 00000100:00100000:1.0:1789048959.464854:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048959.464862:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111541376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048959.464892:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048959.464967:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111541376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (7645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048959.464974:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789048959.464990:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048959.464996:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111541504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048959.465012:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048959.465041:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111541504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (7614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048959.465047:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789048959.467601:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111541504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048959.467650:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111541376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789048959.469612:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789048959.651139:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789048960.111728:0:25436:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789048960.111982:0:25436:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789048960.477739:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111541632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048960.477817:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048960.477989:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541632 00000100:00100000:2.0:1789048960.477999:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541632 00000100:00100000:2.0:1789048960.478058:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789048960.478068:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111541632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048960.478103:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048960.478149:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111541632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048960.478156:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789048960.478269:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789048960.478280:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111541760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789048960.478310:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048960.478491:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541760 00000100:00100000:1.0:1789048960.478496:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541760 00000100:00100000:1.0:1789048960.478519:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789048960.478527:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111541760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048960.478545:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789048960.478580:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111541760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048960.478586:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789048960.478725:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111541632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789048960.488813:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fcd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111541760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789048960.669649:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789048961.246460:0:25487:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789048961.246819:0:25487:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789048961.501655:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789048961.501735:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.501762:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111542016:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.501785:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111542400:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.501807:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.501835:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.501846:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111542528:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.501859:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111542912:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.501880:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.501891:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.501904:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111543040:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.501917:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111543424:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.501935:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.501952:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.501960:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111543552:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.501976:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789048961.501985:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111542272:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.501996:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.502018:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.502023:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789048961.502032:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111542144:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502042:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111542784:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502068:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.502090:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111543296:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502092:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.502120:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.502122:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111542656:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502152:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.502161:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111541888 00000100:00100000:3.0:1789048961.502170:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111541888 00000100:00100000:2.0:1789048961.502173:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111543168:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502196:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048961.502223:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542016 00000100:00100000:2.0:1789048961.502228:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542016 00000100:00100000:3.0:1789048961.502237:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789048961.502249:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111541888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048961.502264:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789048961.502274:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3620:x1875953111542016:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789048961.502290:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789048961.502323:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3620:x1875953111542016:12345-0@lo:400:kworker.0 Request processed in 50us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502355:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789048961.502371:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111541888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.502393:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789048961.502393:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542528 00000100:00100000:2.0:1789048961.502399:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542528 00000100:00100000:3.0:1789048961.502421:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542400 00000100:00100000:3.0:1789048961.502427:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542400 00000100:00100000:2.0:1789048961.502427:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543040 00000100:00100000:2.0:1789048961.502433:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543040 00000100:00100000:3.0:1789048961.502452:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542912 00000100:00100000:2.0:1789048961.502456:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543424 00000100:00100000:3.0:1789048961.502457:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542912 00000100:00100000:2.0:1789048961.502462:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543424 00000100:00100000:3.0:1789048961.502482:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542272 00000100:00100000:2.0:1789048961.502486:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543552 00000100:00100000:3.0:1789048961.502487:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542272 00000100:00100000:2.0:1789048961.502493:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543552 00000100:00100000:3.0:1789048961.502511:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542784 00000100:00100000:3.0:1789048961.502515:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542784 00000100:00100000:2.0:1789048961.502517:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543296 00000100:00100000:2.0:1789048961.502522:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543296 00000100:00100000:3.0:1789048961.502539:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789048961.502545:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543168 00000100:00100000:3.0:1789048961.502552:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111542400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502552:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543168 00000100:00100000:2.0:1789048961.502577:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789048961.502587:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111542528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502594:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111542400:12345-0@lo:400:kworker.0 Request processed in 46us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.502601:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789048961.502616:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789048961.502625:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111542912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502631:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875953111542528:12345-0@lo:400:kworker.0 Request processed in 45us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502663:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789048961.502671:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111542912:12345-0@lo:400:kworker.0 Request processed in 48us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.502678:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789048961.502682:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789048961.502692:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111543040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502698:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789048961.502707:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111542272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502731:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875953111543040:12345-0@lo:400:kworker.0 Request processed in 41us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502738:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789048961.502747:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111542272:12345-0@lo:400:kworker.0 Request processed in 41us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502755:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789048961.502756:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789048961.502767:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111543424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502783:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789048961.502793:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111542784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502801:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111543424:12345-0@lo:400:kworker.0 Request processed in 37us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502807:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789048961.502822:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048961.502836:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111542784:12345-0@lo:400:kworker.0 Request processed in 41us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502836:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111543552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502849:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789048961.502879:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875953111543552:12345-0@lo:400:kworker.0 Request processed in 49us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.502882:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789048961.502892:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789048961.502897:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111543296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.502910:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789048961.502920:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111543168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.502935:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111543296:12345-0@lo:400:kworker.0 Request processed in 42us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.502941:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789048961.502969:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542144 00000100:00100000:3.0:1789048961.502974:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542144 00000100:00100000:2.0:1789048961.502974:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111543168:12345-0@lo:400:kworker.0 Request processed in 55us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.502983:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789048961.503000:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111542656 00000100:00100000:3.0:1789048961.503004:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111542656 00000100:00100000:2.0:1789048961.503016:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789048961.503025:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111542144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.503054:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111542144:12345-0@lo:400:kworker.0 Request processed in 31us (966us total) trans 0 rc 0/0 00000100:00080000:3.0:1789048961.503288:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789048961.503293:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789048961.503295:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048961.503297:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048961.503311:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111543680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048961.503369:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048961.503480:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111542272:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.503492:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111542784:0@lo:400:kworker.0 00010000:00080000:3.0:1789048961.503504:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b610a80 x1875953111543296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048961.503514:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111543296:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.503526:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111542400:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.503545:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111542912:0@lo:400:kworker.0 00010000:00080000:3.0:1789048961.503555:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b611500 x1875953111543424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048961.503563:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111543424:0@lo:400:kworker.0 00000100:00100000:3.0:1789048961.503578:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08845f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048961.504533:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543680 00000100:00100000:1.0:1789048961.504543:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543680 00000100:00100000:1.0:1789048961.504597:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048961.504606:0:24213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111543680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048961.504627:0:24213:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048961.504718:0:24213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111543680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048961.504734:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789048961.505602:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789048961.505628:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048961.505638:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111542656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.505714:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111542656:12345-0@lo:400:kworker.0 Request processed in 80us (3561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.505721:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789048961.505781:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111542144:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.505792:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111542656:0@lo:400:kworker.0 00010000:00080000:2.0:1789048961.505805:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b612680 x1875953111543168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048961.505816:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111543168:0@lo:400:kworker.0 00000100:00100000:2.0:1789048961.505826:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111542016:0@lo:400:kworker.0 00010000:00080000:2.0:1789048961.505837:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b612a00 x1875953111542528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048961.505844:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875953111542528:0@lo:400:kworker.0 00010000:00080000:2.0:1789048961.505854:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b611880 x1875953111543040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048961.505861:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875953111543040:0@lo:400:kworker.0 00010000:00080000:2.0:1789048961.505871:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c2b612300 x1875953111543552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048961.505878:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3620:1875953111543552:0@lo:400:kworker.0 00000100:00100000:0.0:1789048961.507047:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3d312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111543680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048961.581927:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.582494:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097790720 00000100:00100000:2.0:1789048961.582506:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097790720 00000100:00100000:2.0:1789048961.582569:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:2.0:1789048961.582577:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2390:x1875953097790720:12345-192.168.202.16@tcp:250:mount.lustre.0 00010000:00080000:2.0:1789048961.582607:0:22697:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e7caf8bb-664b-472f-b0ee-e5fe282977ce@192.168.202.16@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1789048961.582638:0:22697:0:(genops.c:1384:class_connect()) connect: client e7caf8bb-664b-472f-b0ee-e5fe282977ce, cookie 0x133f221c08777d50 00000100:00080000:2.0:1789048961.582791:0:22697:0:(import.c:65:import_set_state_nolock()) ffff959b080cd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048961.582868:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+5:2390:x1875953097790720:12345-192.168.202.16@tcp:250:mount.lustre.0 Request processed in 290us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.582877:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 115 00000100:00100000:3.0:1789048961.593253:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.593368:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097790848 00000100:00100000:1.0:1789048961.593378:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097790848 00000100:00100000:1.0:1789048961.593436:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1789048961.593445:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+5:18114:x1875953097790848:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789048961.593471:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048961.593489:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08364c00/0x133f221c08777d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29cb2 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048961.593516:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08364c00/0x133f221c08777d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cb2 expref: 6 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048961.593526:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08364c00/0x133f221c08777d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cb2 expref: 6 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048961.593536:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364c00, rc 0) 00000100:00100000:1.0:1789048961.593595:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+6:18114:x1875953097790848:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 151us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048961.593603:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 116 00000100:00100000:1.0:1789048961.609426:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.609605:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097790976 00000100:00100000:2.0:1789048961.609616:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097790976 00000100:00100000:2.0:1789048961.609682:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:2.0:1789048961.609693:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+6:18114:x1875953097790976:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789048961.609818:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+6:18114:x1875953097790976:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 126us (402us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789048961.609826:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 117 00000100:00100000:2.0:1789048961.620669:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048961.620836:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791104 00000100:00100000:0.0:1789048961.620846:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791104 00000100:00100000:0.0:1789048961.620911:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:0.0:1789048961.620921:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+6:18114:x1875953097791104:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789048961.620939:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048961.620969:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef39200/0x133f221c08777d5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29cb9 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048961.621010:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef39200/0x133f221c08777d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cb9 expref: 7 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048961.621022:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef39200/0x133f221c08777d5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cb9 expref: 7 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048961.621031:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39200, rc 0) 00000100:00100000:0.0:1789048961.621095:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+7:18114:x1875953097791104:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 175us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048961.621103:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:3.0:1789048961.626964:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.627128:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791232 00000100:00100000:1.0:1789048961.627140:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791232 00000100:00100000:1.0:1789048961.627204:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:1.0:1789048961.627214:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+7:18114:x1875953097791232:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789048961.627411:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18114:x1875953097791232:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 197us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048961.627435:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000040:00080000:2.0:1789048961.630589:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789048961.631316:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.633749:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791360 00000100:00100000:2.0:1789048961.633765:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791360 00000100:00100000:2.0:1789048961.633845:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789048961.633857:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18114:x1875953097791360:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789048961.634026:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3ea8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18114:x1875953097791360:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 171us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.634043:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789048961.638687:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048961.638923:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791488 00000100:00100000:0.0:1789048961.638933:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791488 00000100:00100000:0.0:1789048961.638998:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:0.0:1789048961.639008:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18133:x1875953097791488:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048961.639165:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18133:x1875953097791488:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 158us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048961.639174:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:3.0:1789048961.676922:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.677881:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791616 00000100:00100000:1.0:1789048961.677894:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791616 00000100:00100000:1.0:1789048961.677959:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1789048961.677970:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18133:x1875953097791616:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789048961.678114:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18133:x1875953097791616:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 146us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048961.678119:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1789048961.680068:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.680389:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791744 00000100:00100000:2.0:1789048961.680398:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791744 00000100:00100000:2.0:1789048961.680610:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789048961.680624:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18133:x1875953097791744:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048961.680770:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20814450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18133:x1875953097791744:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 148us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.680778:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00010000:00010000:3.0:1789048961.693699:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048961.694075:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.699132:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097791872 00000100:00100000:1.0:1789048961.699147:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097791872 00000100:00100000:0.0:1789048961.699379:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:0.0:1789048961.699389:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+8:18114:x1875953097791872:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789048961.699404:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048961.699421:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38800/0x133f221c08777d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29cea expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048961.699461:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38800/0x133f221c08777d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cea expref: 9 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048961.699486:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38800/0x133f221c08777d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cea expref: 9 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048961.699496:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38800, rc 0) 00000100:00100000:0.0:1789048961.699606:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20814050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+9:18114:x1875953097791872:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 218us (5536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048961.699613:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:3.0:1789048961.709885:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.710542:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792000 00000100:00100000:2.0:1789048961.710553:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792000 00000100:00100000:2.0:1789048961.710616:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:2.0:1789048961.710626:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+9:18114:x1875953097792000:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789048961.710660:0:22697:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789048961.710684:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789048961.710688:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789048961.711950:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789048961.711957:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789048961.711959:0:22697:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789048961.721154:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20815050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+9:18114:x1875953097792000:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 10521us (11267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.721166:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:0.0:1789048961.724931:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.725002:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792128 00000100:00100000:2.0:1789048961.725011:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792128 00000100:00100000:2.0:1789048961.725058:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:2.0:1789048961.725078:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+9:18114:x1875953097792128:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048961.725093:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048961.725108:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29cf1 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048961.725129:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 10 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048961.725136:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 10 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048961.725142:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba1400, rc 0) 00000100:00100000:2.0:1789048961.725186:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18114:x1875953097792128:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 110us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.725191:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:3.0:1789048961.730514:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.731635:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792256 00000100:00100000:2.0:1789048961.731656:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792256 00000100:00100000:2.0:1789048961.731724:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:2.0:1789048961.731734:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3edc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18114:x1875953097792256:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789048961.731912:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3edc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18114:x1875953097792256:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 179us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.731920:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1789048961.735771:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048961.735879:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792384 00000100:00100000:3.0:1789048961.735889:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792384 00000100:00100000:3.0:1789048961.735963:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:3.0:1789048961.735970:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c19ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18114:x1875953097792384:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789048961.736105:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c19ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18114:x1875953097792384:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.736110:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:3.0:1789048961.739214:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048961.739745:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792512 00000100:00100000:0.0:1789048961.739754:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792512 00000100:00100000:0.0:1789048961.739826:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:0.0:1789048961.739836:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18136:x1875953097792512:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789048961.739979:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18136:x1875953097792512:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 144us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048961.739987:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:0.0:1789048961.742940:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048961.743020:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792640 00000100:00100000:3.0:1789048961.743040:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792640 00000100:00100000:3.0:1789048961.743099:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:3.0:1789048961.743109:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18136:x1875953097792640:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048961.743463:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18136:x1875953097792640:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 149us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.743479:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:1.0:1789048961.752279:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.752406:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.752560:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792768 00000100:00100000:2.0:1789048961.752570:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792768 00000100:00100000:2.0:1789048961.752609:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793024 00000100:00100000:2.0:1789048961.752611:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793024 00000100:00100000:2.0:1789048961.752633:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789048961.752641:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1875953097792768:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789048961.752696:0:22705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ab02f1da-990a-440f-8505-d0174933fc99@192.168.202.16@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1789048961.752757:0:22705:0:(genops.c:1384:class_connect()) connect: client ab02f1da-990a-440f-8505-d0174933fc99, cookie 0x133f221c08777d73 00000004:00100000:2.0:1789048961.752782:0:22705:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789048961.752987:0:22705:0:(import.c:65:import_set_state_nolock()) ffff959b08062800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048961.753049:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:2390:x1875953097792768:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 407us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.753057:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789048961.753076:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789048961.753081:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2390:x1875953097793024:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789048961.753098:0:22705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from ab02f1da-990a-440f-8505-d0174933fc99@192.168.202.16@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:2.0:1789048961.753125:0:22705:0:(genops.c:1384:class_connect()) connect: client ab02f1da-990a-440f-8505-d0174933fc99, cookie 0x133f221c08777d7a 00000004:00100000:2.0:1789048961.753137:0:22705:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789048961.753423:0:22705:0:(import.c:65:import_set_state_nolock()) ffff959b08064800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789048961.753447:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fcd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:2390:x1875953097793024:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 364us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.753454:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048961.761004:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048961.761556:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048961.761663:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793152 00000100:00100000:2.0:1789048961.761673:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793152 00000100:00100000:2.0:1789048961.761753:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097792896 00000100:00100000:2.0:1789048961.761757:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097792896 00000100:00100000:2.0:1789048961.761786:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789048961.761795:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:0:x1875953097793152:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048961.761833:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048961.761938:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:0:x1875953097793152:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 143us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048961.761955:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00080000:3.0:1789048961.762157:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048961.762161:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048961.762364:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789048961.762376:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:0:x1875953097792896:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048961.762395:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048961.762435:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:0:x1875953097792896:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 63us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.765394:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048961.765502:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793280 00000100:00100000:3.0:1789048961.765512:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793280 00000100:00100000:2.0:1789048961.767582:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1789048961.768400:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1789048961.768420:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793280:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789048961.768456:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789048961.768549:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793280:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 138us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.768556:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1789048961.772153:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.772259:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793408 00000100:00100000:1.0:1789048961.772281:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793408 00000100:00100000:1.0:1789048961.772382:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048961.772393:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793408:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789048961.772475:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793408:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048961.772483:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048961.780961:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.781013:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.781071:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048961.781172:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793536 00000100:00100000:0.0:1789048961.781181:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793536 00000100:00100000:0.0:1789048961.781225:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793664 00000100:00100000:0.0:1789048961.781229:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793664 00000100:00100000:0.0:1789048961.781247:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789048961.781256:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875953097793536:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789048961.781290:0:24211:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ab02f1da-990a-440f-8505-d0174933fc99@192.168.202.16@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:0.0:1789048961.781360:0:24211:0:(genops.c:1384:class_connect()) connect: client ab02f1da-990a-440f-8505-d0174933fc99, cookie 0x133f221c08777d81 00002000:00100000:0.0:1789048961.781374:0:24211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ab02f1da-990a-440f-8505-d0174933fc99/ffff959b0838f800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048961.781393:0:24211:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789048961.781559:0:24211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789048961.781590:0:24211:0:(import.c:65:import_set_state_nolock()) ffff959b0838e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048961.781667:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2390:x1875953097793536:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 410us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048961.781674:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:0.0:1789048961.781701:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048961.781707:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875953097793664:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789048961.781725:0:24211:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ab02f1da-990a-440f-8505-d0174933fc99@192.168.202.16@tcp t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:0.0:1789048961.781741:0:24211:0:(genops.c:1384:class_connect()) connect: client ab02f1da-990a-440f-8505-d0174933fc99, cookie 0x133f221c08777d88 00002000:00100000:0.0:1789048961.781746:0:24211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ab02f1da-990a-440f-8505-d0174933fc99/ffff959b0838f000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048961.781752:0:24211:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789048961.781863:0:24211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789048961.781878:0:24211:0:(import.c:65:import_set_state_nolock()) ffff959b0838b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048961.781901:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2390:x1875953097793664:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 193us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048961.781907:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789048961.782371:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793792 00000100:00100000:3.0:1789048961.782377:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793792 00000100:00100000:3.0:1789048961.782424:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789048961.782432:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c322c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793792:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789048961.782472:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c322c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793792:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 42us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.782479:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1789048961.791384:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048961.791511:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097793920 00000100:00100000:1.0:1789048961.791534:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097793920 00000100:00100000:1.0:1789048961.791592:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789048961.791602:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3d310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793920:12345-192.168.202.16@tcp:33:mount.lustre.0 00000001:00100000:2.0:1789048961.794280:0:25024:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab02f1da-990a-440f-8505-d0174933fc99 00000001:00080000:2.0:1789048961.794297:0:25024:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000004:00080000:0.0:1789048961.796875:0:22707:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4993us 00000004:00200000:1.0:1789048961.827969:0:22707:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789048961.829689:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3d310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab02f1da-990a-440f-8505-d0174933fc99+6:18114:x1875953097793920:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 38079us (38306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048961.829718:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048962.103846:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048962.103948:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794048 00000100:00100000:0.0:1789048962.103957:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794048 00000100:00100000:0.0:1789048962.104021:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048962.104058:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:18159:x1875953097794048:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:0.0:1789048962.104080:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048962.104106:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29d22 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048962.104171:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048962.104185:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048962.104201:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048962.104268:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048962.104272:0:22706:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048962.104323:0:22706:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048962.104378:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d22 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048962.104398:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d22 expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048962.104406:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:0.0:1789048962.104409:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048962.104413:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38600, rc 0) 00000100:00100000:0.0:1789048962.104482:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+7:18159:x1875953097794048:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 427us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048962.104498:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00010000:00010000:0.0:1789048962.718603:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789048963.746068:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048964.453964:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048964.462790:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794176 00000100:00100000:1.0:1789048964.462805:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794176 00000100:00100000:1.0:1789048964.462978:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789048964.462994:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+7:18212:x1875953097794176:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:1.0:1789048964.463036:0:25241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789048964.463136:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+7:18212:x1875953097794176:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 147us (9182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048964.463143:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00080000:3.0:1789048964.463215:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048964.474648:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048964.474759:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794304 00000100:00100000:0.0:1789048964.474767:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794304 00000100:00080000:3.0:1789048964.474828:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048964.474859:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048964.474870:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:18212:x1875953097794304:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:0.0:1789048964.474903:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789048964.474995:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:18212:x1875953097794304:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048964.475002:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048964.481290:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048964.481381:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794432 00000100:00100000:3.0:1789048964.481392:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794432 00000100:00100000:3.0:1789048964.481475:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1789048964.481482:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab02f1da-990a-440f-8505-d0174933fc99+6:18212:x1875953097794432:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:3.0:1789048964.481512:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048964.481649:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab02f1da-990a-440f-8505-d0174933fc99+6:18212:x1875953097794432:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 167us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048964.481657:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00080000:1.0:1789048964.484369:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789048964.486909:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048964.487108:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794560 00000100:00100000:1.0:1789048964.487117:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794560 00000100:00100000:1.0:1789048964.487193:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1789048964.487204:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab02f1da-990a-440f-8505-d0174933fc99+5:18212:x1875953097794560:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:1.0:1789048964.487232:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048964.487311:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08847480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ab02f1da-990a-440f-8505-d0174933fc99+5:18212:x1875953097794560:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 111us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048964.487316:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00080000:3.0:1789048964.489595:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048964.574416:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111543936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048964.574495:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048964.574557:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789048964.574564:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111543808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789048964.574586:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048964.574684:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543936 00000100:00100000:2.0:1789048964.574692:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543936 00000100:00100000:2.0:1789048964.574752:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111543808 00000100:00100000:2.0:1789048964.574755:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111543808 00000100:00100000:2.0:1789048964.574773:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048964.574793:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111543936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789048964.574817:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048964.574861:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111543936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.574867:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789048964.574883:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048964.574888:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111543808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789048964.574916:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789048964.574941:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111543808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.574961:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789048964.575006:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c08a8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111543808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048964.575018:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111543936:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789048964.576958:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789048964.765799:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048964.788212:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048964.788386:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794688 00000100:00100000:2.0:1789048964.788396:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794688 00000100:00100000:2.0:1789048964.788456:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:2.0:1789048964.788474:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+10:18242:x1875953097794688:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048964.788492:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048964.788511:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0000/0x133f221c08777d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29d29 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048964.788540:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0000/0x133f221c08777d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d29 expref: 11 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048964.788551:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0000/0x133f221c08777d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d29 expref: 11 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048964.788560:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0000, rc 0) 00000100:00100000:2.0:1789048964.788632:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18242:x1875953097794688:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 167us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.788638:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:0.0:1789048964.804791:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048964.804986:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794816 00000100:00100000:3.0:1789048964.804996:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794816 00000100:00100000:3.0:1789048964.805056:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1789048964.805066:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18242:x1875953097794816:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789048964.805239:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18242:x1875953097794816:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 173us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048964.805247:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1789048964.825399:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048964.825587:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097794944 00000100:00100000:0.0:1789048964.825597:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097794944 00000100:00100000:0.0:1789048964.825673:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:0.0:1789048964.825682:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18242:x1875953097794944:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789048964.825840:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18242:x1875953097794944:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 158us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048964.825859:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:0.0:1789048964.860741:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048964.861269:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795072 00000100:00100000:2.0:1789048964.861280:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795072 00000100:00100000:2.0:1789048964.861375:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:2.0:1789048964.861385:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18250:x1875953097795072:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048964.861566:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18250:x1875953097795072:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 182us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.861574:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 134 00000100:00100000:1.0:1789048964.931188:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048964.931386:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795200 00000100:00100000:3.0:1789048964.931397:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795200 00000100:00100000:3.0:1789048964.931457:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:3.0:1789048964.931467:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18250:x1875953097795200:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048964.931660:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18250:x1875953097795200:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 193us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048964.931687:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:0.0:1789048964.948312:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048964.948485:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795328 00000100:00100000:3.0:1789048964.948494:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795328 00000100:00100000:3.0:1789048964.948549:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:3.0:1789048964.948559:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18250:x1875953097795328:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789048964.952193:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18250:x1875953097795328:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 3623us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.952209:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:1.0:1789048964.963968:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048964.964165:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795456 00000100:00100000:2.0:1789048964.964175:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795456 00000100:00100000:2.0:1789048964.964237:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:2.0:1789048964.964246:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18242:x1875953097795456:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789048964.964263:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048964.964282:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b07ba0c00/0x133f221c08777da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29d5a expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048964.964314:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba0c00/0x133f221c08777da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d5a expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048964.964325:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b07ba0c00/0x133f221c08777da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d5a expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048964.964365:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b07ba0c00, rc 0) 00000100:00100000:2.0:1789048964.964472:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18242:x1875953097795456:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 226us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.964479:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:1.0:1789048964.984753:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048964.984998:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795584 00000100:00100000:2.0:1789048964.985009:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795584 00000100:00100000:2.0:1789048964.985073:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:2.0:1789048964.985097:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18242:x1875953097795584:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789048964.985124:0:22697:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789048964.985141:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789048964.985146:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789048964.985149:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789048964.985152:0:22697:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789048964.985155:0:22697:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1789048964.986912:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18242:x1875953097795584:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 1811us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.986925:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:1.0:1789048964.991060:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048964.991140:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795712 00000100:00100000:3.0:1789048964.991150:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795712 00000100:00100000:3.0:1789048964.991205:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:3.0:1789048964.991214:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18242:x1875953097795712:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789048964.991232:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048964.991249:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29d61 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048964.991277:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048964.991287:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 13 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048964.991296:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836c00, rc 0) 00000100:00100000:3.0:1789048964.991392:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18242:x1875953097795712:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 178us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048964.991400:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:1.0:1789048964.994419:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048964.994538:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795840 00000100:00100000:0.0:1789048964.994548:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795840 00000100:00100000:0.0:1789048964.994606:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:0.0:1789048964.994627:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18242:x1875953097795840:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789048964.994793:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18242:x1875953097795840:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 179us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048964.994801:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:1.0:1789048964.998632:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048964.999083:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097795968 00000100:00100000:2.0:1789048964.999093:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097795968 00000100:00100000:2.0:1789048964.999195:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:2.0:1789048964.999204:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18242:x1875953097795968:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789048964.999381:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18242:x1875953097795968:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 178us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048964.999389:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:1.0:1789048965.005859:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048965.006112:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796096 00000100:00100000:3.0:1789048965.006122:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796096 00000100:00100000:3.0:1789048965.006170:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:3.0:1789048965.006177:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18254:x1875953097796096:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048965.006304:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18254:x1875953097796096:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.006310:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:1.0:1789048965.013245:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048965.013300:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796224 00000100:00100000:3.0:1789048965.013312:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796224 00000100:00100000:3.0:1789048965.013462:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:3.0:1789048965.013473:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18254:x1875953097796224:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789048965.013688:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18254:x1875953097796224:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 216us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.013696:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:1.0:1789048965.017457:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048965.017501:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048965.017536:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048965.017622:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048965.017800:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796736 00000100:00100000:0.0:1789048965.017809:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796736 00000100:00100000:0.0:1789048965.017865:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796864 00000100:00100000:0.0:1789048965.017868:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796864 00000100:00100000:0.0:1789048965.017892:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048965.017902:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2391:x1875953097796736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048965.017982:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2391:x1875953097796736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 81us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.017989:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048965.018006:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789048965.018012:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2391:x1875953097796864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048965.018036:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2391:x1875953097796864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.018041:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:3.0:1789048965.018473:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796480 00000100:00100000:3.0:1789048965.018478:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796480 00000100:00100000:3.0:1789048965.018515:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796608 00000100:00100000:3.0:1789048965.018518:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796608 00000100:00100000:3.0:1789048965.018543:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789048965.018551:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c08a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+7:2391:x1875953097796480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048965.018586:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c08a8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+7:2391:x1875953097796480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.018592:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789048965.018605:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789048965.018610:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2391:x1875953097796608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048965.018647:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2391:x1875953097796608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.018653:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:1.0:1789048965.020888:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048965.020923:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048965.021050:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796352 00000100:00100000:0.0:1789048965.021059:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796352 00000100:00100000:0.0:1789048965.021099:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797120 00000100:00100000:0.0:1789048965.021102:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797120 00000100:00100000:0.0:1789048965.021127:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789048965.021134:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875953097796352:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789048965.021160:0:25241:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 33100e65-e304-4913-82a7-bb107e2e9bbb@192.168.202.16@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789048965.021195:0:25241:0:(genops.c:1384:class_connect()) connect: client 33100e65-e304-4913-82a7-bb107e2e9bbb, cookie 0x133f221c08777db2 00000004:00100000:0.0:1789048965.021218:0:25241:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789048965.021304:0:25241:0:(import.c:65:import_set_state_nolock()) ffff959c3c4ae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048965.021388:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2390:x1875953097796352:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 252us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.021396:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789048965.021739:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789048965.021745:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2390:x1875953097797120:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789048965.021762:0:25241:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 33100e65-e304-4913-82a7-bb107e2e9bbb@192.168.202.16@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789048965.021782:0:25241:0:(genops.c:1384:class_connect()) connect: client 33100e65-e304-4913-82a7-bb107e2e9bbb, cookie 0x133f221c08777db9 00000004:00100000:0.0:1789048965.021795:0:25241:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789048965.021838:0:25241:0:(import.c:65:import_set_state_nolock()) ffff959c2effd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048965.021867:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2390:x1875953097797120:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 121us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.021874:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789048965.047872:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048965.048139:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097796992 00000100:00100000:0.0:1789048965.048150:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097796992 00000100:00100000:0.0:1789048965.048227:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789048965.048238:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:0:x1875953097796992:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789048965.048282:0:25241:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789048965.048371:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:0:x1875953097796992:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 135us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.048379:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:1.0:1789048965.051755:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048965.051850:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797376 00000100:00100000:2.0:1789048965.051860:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797376 00000100:00100000:2.0:1789048965.051927:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:2.0:1789048965.051937:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097797376:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048965.051971:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048965.052032:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097797376:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048965.052049:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00080000:3.0:1789048965.055404:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048965.057013:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048965.057101:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797248 00000100:00100000:2.0:1789048965.057125:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797248 00000100:00100000:2.0:1789048965.057194:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789048965.057207:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:0:x1875953097797248:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789048965.057240:0:22704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1789048965.057400:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789048965.062079:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:0:x1875953097797248:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 4860us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048965.062097:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:0.0:1789048965.071227:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048965.075149:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797504 00000100:00100000:2.0:1789048965.075167:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797504 00000100:00100000:2.0:1789048965.075314:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789048965.075327:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097797504:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789048965.075445:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097797504:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 121us (4227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048965.075452:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789048965.086282:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048965.086427:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048965.087155:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797888 00000100:00100000:3.0:1789048965.087166:0:22715:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797888 00000100:00100000:3.0:1789048965.087225:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789048965.087235:0:22715:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097797888:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789048965.087314:0:22715:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c03e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097797888:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 81us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.087321:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789048965.087403:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048965.087782:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797632 00000100:00100000:0.0:1789048965.087788:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797632 00000100:00100000:0.0:1789048965.087809:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097797760 00000100:00100000:0.0:1789048965.087811:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097797760 00000100:00100000:0.0:1789048965.087828:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:0.0:1789048965.087833:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2390:x1875953097797632:12345-192.168.202.16@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789048965.087834:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789048965.087838:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2390:x1875953097797760:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789048965.087859:0:24211:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 33100e65-e304-4913-82a7-bb107e2e9bbb@192.168.202.16@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789048965.087889:0:24211:0:(genops.c:1384:class_connect()) connect: client 33100e65-e304-4913-82a7-bb107e2e9bbb, cookie 0x133f221c08777dc0 00002000:00100000:0.0:1789048965.087900:0:24211:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33100e65-e304-4913-82a7-bb107e2e9bbb/ffff959c2effe000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048965.087909:0:24211:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789048965.087978:0:24211:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789048965.088004:0:24211:0:(import.c:65:import_set_state_nolock()) ffff959c2effc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789048965.088061:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2390:x1875953097797632:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 226us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.088068:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00010000:00080000:0.0:1789048965.094170:0:24209:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 33100e65-e304-4913-82a7-bb107e2e9bbb@192.168.202.16@tcp t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:0.0:1789048965.094246:0:24209:0:(genops.c:1384:class_connect()) connect: client 33100e65-e304-4913-82a7-bb107e2e9bbb, cookie 0x133f221c08777dc7 00002000:00100000:0.0:1789048965.094261:0:24209:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33100e65-e304-4913-82a7-bb107e2e9bbb/ffff959b0817f800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789048965.094282:0:24209:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789048965.094389:0:24209:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789048965.094428:0:24209:0:(import.c:65:import_set_state_nolock()) ffff959b0817e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789048965.094470:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048965.094493:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2390:x1875953097797760:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 6652us (7090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048965.094504:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789048965.094936:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798016 00000100:00100000:3.0:1789048965.094944:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798016 00000100:00100000:3.0:1789048965.095028:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:3.0:1789048965.095053:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097798016:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789048965.095134:0:22708:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789048965.095200:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18242:x1875953097798016:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 163us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.095207:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1789048965.280443:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048965.280534:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798144 00000100:00100000:3.0:1789048965.280543:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798144 00000100:00100000:3.0:1789048965.280593:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:3.0:1789048965.280603:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18277:x1875953097798144:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:3.0:1789048965.280634:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048965.280658:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836000/0x133f221c08777dce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29d92 expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048965.280740:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048965.280752:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048965.280763:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048965.280808:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048965.280811:0:25241:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048965.280827:0:25241:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048965.280845:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836000/0x133f221c08777dce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 8 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048965.280859:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 7 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048965.280864:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:3.0:1789048965.280866:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048965.280869:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836a00, rc 0) 00000100:00100000:3.0:1789048965.280916:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+7:18277:x1875953097798144:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 315us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048965.280923:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048965.597586:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789048965.598158:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111544192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048965.598229:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048965.598284:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c31178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111544064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048965.598306:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048965.598948:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544192 00000100:00100000:1.0:1789048965.598958:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544192 00000100:00100000:1.0:1789048965.598995:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544064 00000100:00100000:1.0:1789048965.598998:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544064 00000100:00100000:1.0:1789048965.599013:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789048965.599022:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111544192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789048965.599058:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789048965.599115:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111544192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048965.599122:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789048965.599138:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789048965.599144:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111544064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048965.599159:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789048965.599198:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111544064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048965.599203:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048965.599361:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111544192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048965.599376:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c31178380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111544064:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789048965.795588:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789048966.303967:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789048966.622232:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111544576:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622302:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.622359:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111545088:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622379:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.622395:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111545600:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622416:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.622443:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789048966.622460:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111544704:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622482:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.622506:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111545216:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622523:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.622552:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111545728:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622570:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.622607:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544576 00000100:00100000:0.0:1789048966.622614:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544576 00000100:00100000:0.0:1789048966.622647:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545088 00000100:00100000:0.0:1789048966.622649:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545088 00000100:00100000:0.0:1789048966.622665:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048966.622672:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111544576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622725:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111544576:12345-0@lo:400:kworker.0 Request processed in 53us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.622731:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048966.622747:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048966.622752:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111545088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622779:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111545088:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.622784:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789048966.622804:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545600 00000100:00100000:0.0:1789048966.622808:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545600 00000100:00100000:0.0:1789048966.622839:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545728 00000100:00100000:0.0:1789048966.622843:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545728 00000100:00100000:0.0:1789048966.622860:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048966.622866:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111545600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622894:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111545600:12345-0@lo:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.622900:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789048966.622911:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048966.622916:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.622952:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875953111545728:12345-0@lo:400:kworker.0 Request processed in 35us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.622958:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789048966.622975:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544704 00000100:00100000:0.0:1789048966.622978:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544704 00000100:00100000:0.0:1789048966.623001:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545216 00000100:00100000:0.0:1789048966.623003:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545216 00000100:00100000:0.0:1789048966.623018:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048966.623024:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111544704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623052:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111544704:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623058:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048966.623067:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789048966.623075:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111545216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623088:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d3f2942-6380-4c90-a339-b9cf9971a742:3623:1875953111544448:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623113:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111545216:12345-0@lo:400:kworker.0 Request processed in 39us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623118:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789048966.623126:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789048966.623136:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048966.623140:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048966.623142:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048966.623149:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111544960:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623170:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.623180:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111544704:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623183:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111545472:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623189:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111545216:0@lo:400:kworker.0 00010000:00080000:0.0:1789048966.623200:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fba5f80 x1875953111545728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048966.623201:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.623210:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3620:1875953111545728:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623213:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111545984:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623219:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111544576:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623230:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.623234:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111545088:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623244:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111545600:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623245:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789048966.623249:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111544320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048966.623273:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544960 00000100:00100000:0.0:1789048966.623276:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544960 00000100:00100000:2.0:1789048966.623278:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.623291:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545472 00000100:00100000:0.0:1789048966.623293:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545472 00000100:00100000:2.0:1789048966.623295:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111544832:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623303:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545984 00000100:00100000:0.0:1789048966.623306:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545984 00000100:00100000:2.0:1789048966.623312:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048966.623326:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111545344:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623329:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789048966.623352:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111544960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623361:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048966.623377:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3fba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111545856:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623395:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048966.623395:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875953111544960:12345-0@lo:400:kworker.0 Request processed in 44us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623402:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789048966.623413:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545856 00000100:00100000:0.0:1789048966.623416:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545856 00000100:00100000:2.0:1789048966.623426:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875953111544960:0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623432:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789048966.623436:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111545472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623447:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789048966.623454:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111545984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048966.623465:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111545472:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623471:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789048966.623478:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111545984:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623482:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789048966.623485:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789048966.623487:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111545856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623502:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544448 00000100:00100000:2.0:1789048966.623505:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544448 00000100:00100000:0.0:1789048966.623510:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111545856:12345-0@lo:400:kworker.0 Request processed in 23us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623515:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789048966.623529:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1789048966.623529:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048966.623535:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3623:x1875953111544448:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789048966.623538:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048966.623545:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544832 00000100:00100000:0.0:1789048966.623548:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544832 00000100:00100000:2.0:1789048966.623562:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3623:x1875953111544448:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048966.623568:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789048966.623568:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111545344 00000100:00100000:0.0:1789048966.623570:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111545344 00000100:00100000:0.0:1789048966.623585:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789048966.623590:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111544832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623592:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111544320 00000100:00100000:2.0:1789048966.623594:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111544320 00000100:00100000:2.0:1789048966.623629:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048966.623635:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111544320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048966.623636:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111544832:12345-0@lo:400:kworker.0 Request processed in 46us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623641:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789048966.623650:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789048966.623655:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111545344:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789048966.623667:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789048966.623677:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3623:x1875953111545344:12345-0@lo:400:kworker.0 Request processed in 22us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048966.623682:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789048966.623696:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048966.623699:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111544320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048966.623705:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789048966.623731:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111544320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789048966.623740:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789048966.623752:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111544832:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623759:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111545344:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623767:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111545856:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623773:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d3f2942-6380-4c90-a339-b9cf9971a742:3623:1875953111544448:0@lo:400:kworker.0 00000100:00100000:2.0:1789048966.623781:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111545472:0@lo:400:kworker.0 00010000:00080000:2.0:1789048966.623789:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959c3fba6680 x1875953111545984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048966.623798:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3fba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111545984:0@lo:400:kworker.0 00000100:00100000:1.0:1789048966.624667:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111546112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048966.624712:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048966.624795:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546112 00000100:00100000:3.0:1789048966.624812:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546112 00000100:00100000:3.0:1789048966.624849:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789048966.624856:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111546112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048966.624871:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789048966.625050:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111546112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 194us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048966.625056:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789048966.625321:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111546112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789048966.813949:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789048967.144763:0:23437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 33100e65-e304-4913-82a7-bb107e2e9bbb 00000001:00100000:0.0:1789048967.144778:0:23437:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ab02f1da-990a-440f-8505-d0174933fc99 00000001:00100000:2.0:1789048967.145577:0:22684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33100e65-e304-4913-82a7-bb107e2e9bbb 00000001:00100000:2.0:1789048967.145587:0:22684:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab02f1da-990a-440f-8505-d0174933fc99 00000001:00100000:3.0:1789048967.151488:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33100e65-e304-4913-82a7-bb107e2e9bbb 00000001:00100000:3.0:1789048967.151501:0:24205:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab02f1da-990a-440f-8505-d0174933fc99 00010000:00010000:2.0:1789048967.844848:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789048968.584436:0:25585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789048968.862199:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048969.696228:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111546240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048969.696306:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048969.696512:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546240 00000100:00100000:3.0:1789048969.696521:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546240 00000100:00100000:3.0:1789048969.696584:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048969.696594:0:24213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111546240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048969.696631:0:24213:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048969.696675:0:24213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111546240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048969.696682:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789048969.696724:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08844000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111546240:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789048969.696925:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048969.699108:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048969.699137:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c31179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111546368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048969.699196:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048969.700731:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546368 00000100:00100000:1.0:1789048969.700741:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546368 00000100:00100000:1.0:1789048969.700811:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048969.700819:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111546368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048969.700841:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048969.700904:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111546368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048969.700912:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789048969.700952:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c31179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111546368:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789048969.701048:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789048969.887722:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048970.315571:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.315619:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.315638:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.315680:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048970.315713:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798656 00000100:00100000:1.0:1789048970.315735:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798656 00000100:00100000:1.0:1789048970.315814:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789048970.315826:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2392:x1875953097798656:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048970.315896:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2392:x1875953097798656:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048970.315904:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789048970.315917:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798400 00000100:00100000:3.0:1789048970.315924:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798400 00000100:00100000:3.0:1789048970.315962:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798912 00000100:00100000:3.0:1789048970.315966:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798912 00000100:00100000:3.0:1789048970.315988:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1789048970.315996:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:2392:x1875953097798400:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048970.316083:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799168 00000100:00100000:0.0:1789048970.316088:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799168 00000100:00100000:0.0:1789048970.316119:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048970.316126:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c07724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2392:x1875953097799168:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048970.316186:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1789048970.316195:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2392:x1875953097798912:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048970.317540:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+6:2392:x1875953097798400:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1539us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048970.317671:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00080000:3.0:1789048970.317978:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048970.317984:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048970.323949:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c07724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2392:x1875953097799168:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 7805us (8250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048970.323966:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:2.0:1789048970.325273:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.325430:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.325455:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048970.325673:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2392:x1875953097798912:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 9476us (10029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048970.325695:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:1.0:1789048970.325723:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798528 00000100:00100000:1.0:1789048970.325731:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798528 00000100:00100000:1.0:1789048970.325780:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789048970.325789:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+5:2392:x1875953097798528:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048970.325834:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+5:2392:x1875953097798528:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048970.325841:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00080000:1.0:1789048970.325863:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048970.326521:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798272 00000100:00100000:0.0:1789048970.326529:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798272 00000100:00100000:0.0:1789048970.326648:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:0.0:1789048970.326657:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2392:x1875953097798272:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048970.326692:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2392:x1875953097798272:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048970.326698:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:0.0:1789048970.326956:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097798784 00000100:00100000:0.0:1789048970.326961:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097798784 00000100:00100000:0.0:1789048970.327002:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789048970.327010:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2392:x1875953097798784:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048970.327046:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2392:x1875953097798784:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 37us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048970.327053:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789048970.328053:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.328111:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048970.328153:0:25242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799296 00000100:00100000:2.0:1789048970.328160:0:25242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799296 00000100:00100000:2.0:1789048970.328204:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789048970.328213:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2392:x1875953097799296:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048970.328262:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2392:x1875953097799296:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048970.328269:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00080000:1.0:1789048970.329269:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048970.331833:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799040 00000100:00100000:0.0:1789048970.331849:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799040 00000100:00100000:0.0:1789048970.331921:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:0.0:1789048970.331932:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2392:x1875953097799040:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048970.332037:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2392:x1875953097799040:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 107us (3989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048970.332045:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00080000:1.0:1789048970.332270:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048970.718603:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111546496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048970.718686:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048970.718892:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546496 00000100:00100000:2.0:1789048970.718901:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546496 00000100:00100000:2.0:1789048970.718957:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789048970.718967:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111546496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048970.719003:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048970.719049:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111546496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048970.719056:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789048970.719407:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111546496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048970.723783:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c31179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111546624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048970.723893:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048970.724389:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546624 00000100:00100000:2.0:1789048970.724398:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546624 00000100:00100000:2.0:1789048970.724461:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789048970.724470:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111546624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048970.724511:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048970.732893:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111546624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8414us (8990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048970.732908:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789048970.739617:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c31179500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111546624:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789048970.909717:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789048971.232372:0:25024:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33100e65-e304-4913-82a7-bb107e2e9bbb 00000100:00100000:0.0:1789048971.742557:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048971.742610:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111546752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789048971.742629:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.742641:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111546880:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.742670:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048971.742678:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111547648:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.742693:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111547392:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.742711:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.742729:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111547904:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.742746:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.742761:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111548416:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.742781:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.742804:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789048971.742809:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111547136:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.742819:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111548416 00000100:00100000:1.0:1789048971.742827:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111548416 00000100:00100000:2.0:1789048971.742831:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.742847:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111547520:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.742863:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.743032:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111548032:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.743053:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048971.743102:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048971.743176:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547392 00000100:00100000:3.0:1789048971.743180:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547392 00000100:00100000:3.0:1789048971.743209:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547904 00000100:00100000:3.0:1789048971.743212:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547904 00000100:00100000:3.0:1789048971.743235:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048971.743245:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111547392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.743299:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111547392:12345-0@lo:400:kworker.0 Request processed in 56us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048971.743306:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789048971.743322:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048971.743376:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111548160:0@lo:400:kworker.0 00000100:00100000:0.0:1789048971.743411:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547008 00000100:00100000:0.0:1789048971.743415:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547008 00000100:00100000:0.0:1789048971.743440:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789048971.743446:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111547008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789048971.743472:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789048971.743509:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111547008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048971.743517:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048971.744439:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111547904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745029:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111547904:12345-0@lo:400:kworker.0 Request processed in 598us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048971.745037:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789048971.745070:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546880 00000100:00100000:3.0:1789048971.745075:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546880 00000100:00100000:3.0:1789048971.745112:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789048971.745118:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3622:x1875953111546880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745150:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3622:x1875953111546880:12345-0@lo:400:kworker.0 Request processed in 33us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048971.745156:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789048971.745199:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048971.745228:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111547264:0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745271:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048971.745289:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111547776:0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745307:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048971.745322:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111548288:0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745368:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111546752 00000100:00100000:3.0:1789048971.745372:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111546752 00000100:00100000:3.0:1789048971.745397:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048971.745402:0:24213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111546752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048971.745416:0:24213:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789048971.745448:0:24213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111546752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048971.745454:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048971.745469:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547264 00000100:00100000:3.0:1789048971.745472:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547264 00000100:00100000:3.0:1789048971.745492:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547776 00000100:00100000:3.0:1789048971.745495:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547776 00000100:00100000:3.0:1789048971.745507:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048971.745512:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111547264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745540:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08844380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111547264:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048971.745545:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789048971.745566:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789048971.745572:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111547776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.745596:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111547776:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048971.745602:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048971.748734:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547520 00000100:00100000:1.0:1789048971.748749:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547520 00000100:00100000:1.0:1789048971.749999:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789048971.750018:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111548416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.750105:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111548416:12345-0@lo:400:kworker.0 Request processed in 96us (7322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.750112:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789048971.750132:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789048971.750139:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.750166:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875953111547520:12345-0@lo:400:kworker.0 Request processed in 28us (7301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.750171:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789048971.750208:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547136 00000100:00100000:1.0:1789048971.750228:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547136 00000100:00100000:1.0:1789048971.750251:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111547648 00000100:00100000:1.0:1789048971.750253:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111547648 00000100:00100000:1.0:1789048971.750263:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789048971.750268:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111547136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.750298:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111547136:12345-0@lo:400:kworker.0 Request processed in 30us (7467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.750304:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789048971.750314:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789048971.750319:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111547648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.750374:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875953111547648:12345-0@lo:400:kworker.0 Request processed in 55us (7271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.750379:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789048971.750615:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789048971.750621:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789048971.750624:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048971.751314:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111548544:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.751369:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048971.751399:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b05d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111546880:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.751414:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111547392:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.751426:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111547904:0@lo:400:kworker.0 00000100:00100000:2.0:1789048971.751436:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751438:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111548032 00000100:00100000:1.0:1789048971.751443:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111548032 00000100:00100000:2.0:1789048971.751466:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111547136:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751466:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111548544 00000100:00100000:1.0:1789048971.751468:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111548544 00000100:00100000:2.0:1789048971.751476:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875953111547520:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751488:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048971.751495:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111548032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751532:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875953111548032:12345-0@lo:400:kworker.0 Request processed in 37us (8477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.751537:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048971.751562:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048971.751568:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111548544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751596:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875953111548544:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.751612:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789048971.751628:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048971.751651:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048971.751696:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048971.751709:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3620:1875953111547648:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751731:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111548160 00000100:00100000:1.0:1789048971.751734:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111548160 00000100:00100000:1.0:1789048971.751756:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048971.751762:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111548160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751795:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875953111548160:12345-0@lo:400:kworker.0 Request processed in 33us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.751800:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789048971.751826:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048971.751841:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3620:1875953111548160:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.751860:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875953111548032:0@lo:400:kworker.0 00010000:00080000:1.0:1789048971.751871:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747dc00 x1875953111548544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048971.751881:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3622:1875953111548544:0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.755305:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048971.755417:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111546752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048971.755434:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111547264:0@lo:400:kworker.0 00000100:00100000:3.0:1789048971.755445:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111547776:0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.755538:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111548288 00000100:00100000:1.0:1789048971.755545:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111548288 00000100:00100000:1.0:1789048971.755621:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048971.755629:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111548288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048971.755792:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111548288:12345-0@lo:400:kworker.0 Request processed in 163us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048971.755892:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789048971.756015:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789048971.756036:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b0747c700 x1875953111548288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789048971.756046:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111548288:0@lo:400:kworker.0 00000040:00080000:3.0:1789048971.871380:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789048971.933647:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048972.966073:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789048973.358369:0:25732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc21750bf0 20000000:00000080:1.0:1789048973.358387:0:25732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff959b08cdb400 uarg=0000000000000000 20000000:01000000:1.0:1789048973.358430:0:25732:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789048973.358436:0:25732:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789048973.358440:0:25732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789048973.371153:0:25733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789048973.378659:0:25732:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789048973.394174:0:25732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789048973.394381:0:25732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394401:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a32 expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394410:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a40 expref: 23 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394417:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777a7f expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394424:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777c00 expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394435:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394460:0:25732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394469:0:25732:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394513:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.394589:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 12 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048973.394606:0:25732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111548672:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048973.395451:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 12 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.395467:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 12 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.395477:0:25732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111548800:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048973.395510:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777c00 expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.395548:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777c00 expref: 23 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.395561:0:25732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08846680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111548928:0@lo:104: 00000100:00100000:3.0:1789048973.395604:0:25732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048973.395741:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111548928 00000100:00100000:0.0:1789048973.395750:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111548928 00000100:00100000:0.0:1789048973.395817:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789048973.395827:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:25732:x1875953111548928:12345-0@lo:104: 00010000:00010000:0.0:1789048973.395839:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.403848:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789048973.403869:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08845880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:25732:x1875953111548928:12345-0@lo:104: Request processed in 8040us (8261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048973.403882:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1789048973.404086:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777a7f expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.404114:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777a7f expref: 23 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.404130:0:25732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111549056:0@lo:104: 00000100:00100000:3.0:1789048973.404176:0:25732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048973.404204:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777a40 expref: 23 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.404213:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777a40 expref: 23 pid: 22697 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.404222:0:25732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111549184:0@lo:104: 00000100:00100000:3.0:1789048973.404243:0:25732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789048973.404264:0:25732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x133f221c08777a32 expref: 23 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.404272:0:25732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x133f221c08777a32 expref: 23 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.404280:0:25732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111549312:0@lo:104: 00000100:00100000:3.0:1789048973.404300:0:25732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048973.404312:0:25732:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789048973.404356:0:25732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08846680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111548928:0@lo:104: 00010000:00010000:1.0:1789048973.404572:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789048973.404573:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549056 00000100:00100000:0.0:1789048973.404583:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549056 00010000:00010000:1.0:1789048973.404585:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404595:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048973.404599:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404609:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404614:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549184 10000000:00010000:1.0:1789048973.404616:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404618:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549184 10000000:01000000:1.0:1789048973.404627:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789048973.404643:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549312 00000100:00100000:0.0:1789048973.404647:0:22688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549312 00000100:00100000:0.0:1789048973.404662:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789048973.404670:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+5:25732:x1875953111549056:12345-0@lo:104: 00010000:00010000:1.0:1789048973.404675:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.404680:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404683:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789048973.404710:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404730:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef39800/0x133f221c08777c00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777c07 expref: -99 pid: 25023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.404734:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789048973.404742:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+5:25732:x1875953111549056:12345-0@lo:104: Request processed in 72us (565us total) trans 0 rc 0/0 00010000:00010000:1.0:1789048973.404745:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048973.404750:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404750:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789048973.404760:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048973.404763:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404769:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789048973.404777:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404780:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+4:25732:x1875953111549184:12345-0@lo:104: 10000000:00010000:1.0:1789048973.404792:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.404794:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789048973.404805:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789048973.404827:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.404833:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789048973.404834:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789048973.404842:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+4:25732:x1875953111549184:12345-0@lo:104: Request processed in 64us (598us total) trans 0 rc 0/0 00010000:00010000:1.0:1789048973.404846:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404850:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789048973.404859:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef38000/0x133f221c08777a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a86 expref: -99 pid: 24204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.404867:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789048973.404870:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789048973.404876:0:22688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:25732:x1875953111549312:12345-0@lo:104: 00010000:00010000:1.0:1789048973.404882:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.404887:0:22688:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404919:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef3d600 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:1.0:1789048973.404922:0:22693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404930:0:22693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789048973.404937:0:22693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.404943:0:22688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1789048973.404944:0:22693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789048973.404951:0:22688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2d3f2942-6380-4c90-a339-b9cf9971a742+3:25732:x1875953111549312:12345-0@lo:104: Request processed in 76us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048973.404958:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789048973.404963:0:22693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.404971:0:22693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789048973.404975:0:22692:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048973.404992:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405000:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c3ef3d600/0x133f221c08777a40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a47 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405011:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048973.405013:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048973.405015:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048973.405034:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c31178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111549440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048973.405072:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048973.405101:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789048973.405107:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111549568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048973.405137:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048973.405147:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048973.405156:0:22692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.405163:0:22692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07061000 already unused, calling callback (ffffffffc1289c20) 10000000:00010000:0.0:1789048973.405167:0:22692:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048973.405170:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111549696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789048973.405178:0:22692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789048973.405186:0:22692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789048973.405192:0:22692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789048973.405198:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789048973.405212:0:22692:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.405219:0:22692:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789048973.405232:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549440 00010000:00010000:0.0:1789048973.405238:0:22692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048973.405239:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549440 00010000:00010000:0.0:1789048973.405248:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff959c07061000/0x133f221c08777a32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x133f221c08777a39 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405276:0:24236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777c00 expref: 24 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.405277:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048973.405280:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048973.405283:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048973.405290:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789048973.405293:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048973.405306:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549568 00000100:00100000:1.0:1789048973.405310:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549568 00010000:00010000:1.0:1789048973.405321:0:24236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a7f expref: 25 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048973.405353:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549696 00000100:00100000:1.0:1789048973.405357:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549696 00010000:00010000:1.0:1789048973.405369:0:24236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a40 expref: 26 pid: 22697 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048973.405380:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048973.405386:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+26:3620:x1875953111549440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048973.405395:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048973.405399:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777c00 expref: 26 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405409:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777c00 expref: 26 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405422:0:24236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c3ef38400/0x133f221c08777c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777c00 expref: 26 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405444:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048973.405478:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+25:3620:x1875953111549440:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048973.405485:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789048973.405500:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048973.405506:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3620:x1875953111549568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048973.405515:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048973.405519:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a7f expref: 24 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405527:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777a7f expref: 24 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405549:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048973.405572:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3620:x1875953111549568:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048973.405579:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789048973.405591:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048973.405597:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+23:3622:x1875953111549696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789048973.405606:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048973.405610:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a40 expref: 23 pid: 22697 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405619:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777a40 expref: 23 pid: 22697 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.405627:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048973.405655:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+23:3622:x1875953111549696:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048973.405662:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789048973.405690:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d3f2942-6380-4c90-a339-b9cf9971a742:3623:1875953111549824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789048973.405775:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1800/0x133f221c08777a86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777a7f expref: 22 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.405787:0:25732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111549056:0@lo:104: 00010000:00010000:3.0:1789048973.405797:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07060c00/0x133f221c08777a47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777a40 expref: 21 pid: 22697 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.405813:0:25732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111549184:0@lo:104: 00000100:00100000:3.0:1789048973.405825:0:25732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111549312:0@lo:104: 00000100:00100000:0.0:1789048973.406993:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111549568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048973.407005:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c31178a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2d3f2942-6380-4c90-a339-b9cf9971a742:3620:1875953111549440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789048973.407761:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2d3f2942-6380-4c90-a339-b9cf9971a742:3622:1875953111549696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789048973.411210:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048973.411398:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549824 00000100:00100000:2.0:1789048973.411409:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549824 00010000:00010000:2.0:1789048973.411454:0:24236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a32 expref: 21 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048973.411493:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789048973.411502:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+21:3623:x1875953111549824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789048973.411517:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048973.411522:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x133f221c08777a32 expref: 21 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.411543:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x133f221c08777a32 expref: 21 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.411560:0:24236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c07061c00/0x133f221c08777a39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x133f221c08777a32 expref: 21 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048973.411599:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048973.411668:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2d3f2942-6380-4c90-a339-b9cf9971a742+20:3623:x1875953111549824:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (5953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048973.411675:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789048973.411748:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2d3f2942-6380-4c90-a339-b9cf9971a742:3623:1875953111549824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789048973.419272:0:25732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111548672:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048973.419289:0:25732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25732:1875953111548800:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048973.419324:0:25732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048973.426240:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048973.426373:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048973.426476:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799424 00000100:00100000:0.0:1789048973.426486:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799424 00010000:00010000:0.0:1789048973.426547:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 13 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.426590:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799552 00000100:00100000:0.0:1789048973.426593:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799552 00010000:00010000:0.0:1789048973.426606:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 14 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048973.426644:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048973.426653:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+14:2394:x1875953097799424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048973.426670:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048973.426676:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 14 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426715:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 14 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426734:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959c02836c00/0x133f221c08777dab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d61 expref: 14 pid: 22699 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426751:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048973.426802:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a4f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2394:x1875953097799424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 150us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048973.426809:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048973.426853:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:0.0:1789048973.426859:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:2394:x1875953097799552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048973.426866:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048973.426871:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 12 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426880:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 12 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426889:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1400/0x133f221c08777d6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29cf1 expref: 12 pid: 22696 timeout: 828 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426899:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426908:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426934:0:22691:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426941:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426947:0:22691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426954:0:22691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426960:0:22691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1200 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:0.0:1789048973.426964:0:22691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426971:0:22691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426981:0:22691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048973.426991:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048973.427009:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:2394:x1875953097799552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 150us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048973.427015:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00010000:00010000:3.0:1789048973.427383:0:25732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.427391:0:25732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048973.427397:0:25732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff959b07ba1200/0x133f221c08777ddc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048973.982003:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048974.662014:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048974.662121:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799680 00000100:00100000:3.0:1789048974.662135:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799680 00000100:00100000:3.0:1789048974.662217:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1789048974.662229:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+11:18128:x1875953097799680:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048974.662254:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048974.662296:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02836000/0x133f221c08777de3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29d99 expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048974.662585:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02836000/0x133f221c08777de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d99 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048974.662620:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02836000/0x133f221c08777de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d99 expref: 12 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048974.662631:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836000, rc 0) 00000100:00100000:3.0:1789048974.662716:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18128:x1875953097799680:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 489us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048974.662727:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1789048974.670154:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048974.670380:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799808 00000100:00100000:1.0:1789048974.670395:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799808 00000100:00100000:1.0:1789048974.670555:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:1.0:1789048974.670569:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18128:x1875953097799808:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048974.670791:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18128:x1875953097799808:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 225us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048974.670801:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 148 00000100:00100000:3.0:1789048974.673558:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048974.674653:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097799936 00000100:00100000:2.0:1789048974.674671:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097799936 00000100:00100000:2.0:1789048974.674746:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:2.0:1789048974.674814:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18128:x1875953097799936:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048974.675039:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18128:x1875953097799936:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 281us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048974.676624:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:0.0:1789048974.694459:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048974.694875:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800064 00000100:00100000:1.0:1789048974.694890:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800064 00000100:00100000:1.0:1789048974.695030:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:1.0:1789048974.695044:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+12:18128:x1875953097800064:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048974.695068:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048974.695095:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08365600/0x133f221c08777dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd796648991b29da0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048974.695137:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08365600/0x133f221c08777dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29da0 expref: 13 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048974.695151:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08365600/0x133f221c08777dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29da0 expref: 13 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048974.695161:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365600, rc 0) 00000100:00100000:1.0:1789048974.695385:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18128:x1875953097800064:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 343us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048974.695393:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:3.0:1789048974.729535:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048974.729836:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800192 00000100:00100000:0.0:1789048974.729878:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800192 00000100:00100000:0.0:1789048974.729953:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:0.0:1789048974.729965:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18128:x1875953097800192:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048974.730178:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18128:x1875953097800192:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 214us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048974.730186:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:3.0:1789048974.752596:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048974.754779:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800320 00000100:00100000:2.0:1789048974.754801:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800320 00000100:00100000:2.0:1789048974.754916:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:2.0:1789048974.754928:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18128:x1875953097800320:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048974.755391:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:18128:x1875953097800320:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 464us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048974.755401:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:1.0:1789048974.814452:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789048974.814485:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111549952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789048974.814801:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048974.814944:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111549952 00000100:00100000:1.0:1789048974.814955:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111549952 00000100:00100000:1.0:1789048974.815029:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048974.815042:0:24213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111549952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048974.815091:0:24213:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048974.815145:0:24213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111549952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048974.815153:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789048974.815281:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111549952:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789048974.816887:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048974.819362:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789048974.819399:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111550080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789048974.819495:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048974.820411:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550080 00000100:00100000:1.0:1789048974.820425:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550080 00000100:00100000:1.0:1789048974.820548:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789048974.820559:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111550080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789048974.820601:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048974.820670:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111550080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048974.820677:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789048974.821982:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789048974.822061:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111550080:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789048975.005676:0:22701:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048975.005711:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3e9b8000 from 13 10000000:01000000:2.0:1789048975.005718:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048975.005782:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.005800:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.005815:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.005841:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048975.005849:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.006010:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.006262:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048975.006743:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550208 00000100:00100000:3.0:1789048975.006756:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550208 00000100:00100000:3.0:1789048975.006835:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789048975.006847:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+20:22701:x1875953111550208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048975.006865:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048975.006951:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837200/0x133f221c08777df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777df1 expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.006986:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837200/0x133f221c08777df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777df1 expref: 21 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.006998:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837200/0x133f221c08777df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777df1 expref: 21 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.007009:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837200, rc 0) 00000100:00100000:3.0:1789048975.008456:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111550208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1222us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048975.008470:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789048975.008766:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048975.008797:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777df8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.008813:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777df8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048975.009301:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.010029:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.010092:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048975.010146:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550336 00000100:00100000:0.0:1789048975.010156:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550336 00000100:00100000:0.0:1789048975.010228:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789048975.010238:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111550336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048975.010456:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111550336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.010464:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789048975.010527:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.010574:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.010630:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.010660:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75000 going to sleep for 11 seconds 00000100:00100000:1.0:1789048975.010802:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550464 00000100:00100000:1.0:1789048975.010808:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550464 00000100:00100000:1.0:1789048975.010915:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789048975.010923:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111550464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789048975.011033:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111550464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048975.011143:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789048975.011529:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789048975.013127:0:25747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789048975.017944:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789048975.018003:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789048975.018019:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777df8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.018156:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba0800/0x133f221c08777df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777df8 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789048975.018173:0:22701:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789048975.018176:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c414c6800 from 13 10000000:01000000:2.0:1789048975.018180:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789048975.018241:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.018250:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.018263:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048975.018732:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.019012:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.019654:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75000 going to sleep for 11 seconds 00000100:00100000:3.0:1789048975.019766:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550592 00000100:00100000:3.0:1789048975.019779:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550592 00000100:00100000:3.0:1789048975.019977:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789048975.019992:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+21:22701:x1875953111550592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048975.020013:0:22696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048975.020049:0:22696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c02837000/0x133f221c08777e06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777dff expref: -99 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.020087:0:22696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c02837000/0x133f221c08777e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777dff expref: 22 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.020101:0:22696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c02837000/0x133f221c08777e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777dff expref: 22 pid: 22696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.020114:0:22696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837000, rc 0) 00000100:00100000:3.0:1789048975.020185:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111550592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048975.020193:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789048975.020280:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048975.020312:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.020324:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777e06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048975.023321:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.023444:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.030893:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048975.039588:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550720 00000100:00100000:0.0:1789048975.039607:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550720 00000100:00100000:0.0:1789048975.039696:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789048975.039709:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0682a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111550720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048975.039930:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0682a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111550720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (16487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.039938:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789048975.040120:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.040190:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.040258:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.040301:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75000 going to sleep for 11 seconds 00000100:00100000:0.0:1789048975.040426:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550848 00000100:00100000:0.0:1789048975.040431:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550848 00000100:00100000:0.0:1789048975.040453:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789048975.040461:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111550848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048975.040576:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111550848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.040591:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789048975.041575:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048975.056799:0:25748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789048975.058292:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789048975.058369:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048975.058386:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.058402:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959b07ba1200/0x133f221c08777dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e06 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048975.058442:0:22701:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048975.058445:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c3fcc0000 from 13 10000000:01000000:3.0:1789048975.058448:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048975.058500:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.058510:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.058534:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048975.058568:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048975.058656:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048975.058771:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92840 going to sleep for 11 seconds 00000100:00100000:0.0:1789048975.067480:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111550976 00000100:00100000:0.0:1789048975.067506:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111550976 00000100:00100000:0.0:1789048975.067600:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789048975.067613:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+22:22701:x1875953111550976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789048975.067637:0:22699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048975.067665:0:22699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959c3ef38200/0x133f221c08777e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777e0d expref: -99 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.067705:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959c3ef38200/0x133f221c08777e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777e0d expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.067720:0:22699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959c3ef38200/0x133f221c08777e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777e0d expref: 23 pid: 22699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.067730:0:22699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38200, rc 0) 00000100:00100000:0.0:1789048975.067848:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111550976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (9191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.067856:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789048975.068040:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b611880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111550976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789048975.068067:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.068078:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777e14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048975.068177:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.068221:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.068266:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75240 going to sleep for 11 seconds 00000100:00100000:1.0:1789048975.068409:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551104 00000100:00100000:1.0:1789048975.068415:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551104 00000100:00100000:1.0:1789048975.068444:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789048975.068452:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111551104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789048975.068787:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111551104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048975.068796:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789048975.069093:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.069136:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789048975.069199:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.069247:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75240 going to sleep for 11 seconds 00000100:00100000:3.0:1789048975.069306:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551232 00000100:00100000:3.0:1789048975.069311:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551232 00000100:00100000:3.0:1789048975.069378:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789048975.069388:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111551232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048975.069492:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c489450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111551232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048975.069499:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789048975.069603:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789048975.074369:0:25749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789048975.074611:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789048975.074648:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789048975.074665:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.074680:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837e00/0x133f221c08777e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e14 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789048975.074704:0:22701:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789048975.074707:0:22701:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff959c2e493000 from 13 10000000:01000000:3.0:1789048975.074710:0:22701:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789048975.074760:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.074769:0:22701:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.074782:0:22701:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048975.074817:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789048975.074906:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048975.074959:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92780 going to sleep for 11 seconds 00000100:00100000:1.0:1789048975.076181:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551360 00000100:00100000:1.0:1789048975.076198:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551360 00000100:00100000:1.0:1789048975.076278:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789048975.076290:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+23:22701:x1875953111551360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789048975.076321:0:22697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048975.076367:0:22697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff959b08365a00/0x133f221c08777e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x133f221c08777e1b expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048975.076402:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff959b08365a00/0x133f221c08777e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x133f221c08777e1b expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048975.076416:0:22697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff959b08365a00/0x133f221c08777e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x133f221c08777e1b expref: 24 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048975.076426:0:22697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365a00, rc 0) 00000100:00100000:1.0:1789048975.076526:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111551360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048975.076549:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789048975.084929:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789048975.084975:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e22 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.084991:0:22701:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x133f221c08777e22 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048975.085123:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048975.085209:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048975.085261:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048975.085329:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551488 00000100:00100000:0.0:1789048975.085372:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551488 00000100:00100000:0.0:1789048975.085432:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789048975.085444:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111551488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789048975.085630:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111551488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.085638:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789048975.085851:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789048975.085887:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789048975.085954:0:22701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048975.085989:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2ae92780 going to sleep for 11 seconds 00000100:00100000:0.0:1789048975.086044:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551616 00000100:00100000:0.0:1789048975.086056:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551616 00000100:00100000:0.0:1789048975.086094:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789048975.086102:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111551616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789048975.086202:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:22701:x1875953111551616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.086209:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789048975.086293:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2d3f2942-6380-4c90-a339-b9cf9971a742:22701:1875953111551616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789048975.087270:0:25750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789048975.087801:0:22701:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789048975.087827:0:22701:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789048975.087840:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e22 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.087855:0:22701:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff959c02837800/0x133f221c08777e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x133f221c08777e22 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048975.453707:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048975.453762:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048975.453791:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048975.454004:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800704 00000100:00100000:3.0:1789048975.454021:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800704 00000100:00100000:3.0:1789048975.454128:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:3.0:1789048975.454145:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097800704:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789048975.454265:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097800704:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 124us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048975.454274:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00080000:1.0:1789048975.455642:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048975.458883:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800448 00000100:00100000:0.0:1789048975.458909:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800448 00000100:00100000:0.0:1789048975.459013:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:0.0:1789048975.459027:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2394:x1875953097800448:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048975.459133:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2394:x1875953097800448:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 109us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.459142:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:1.0:1789048975.462724:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048975.462787:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048975.466730:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801216 00000100:00100000:0.0:1789048975.466753:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801216 00000100:00100000:0.0:1789048975.466907:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789048975.466921:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2394:x1875953097801216:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048975.467046:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2394:x1875953097801216:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 128us (4336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.467074:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00080000:3.0:1789048975.471212:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789048975.481847:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048975.481902:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048975.487465:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800960 00000100:00100000:2.0:1789048975.487489:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800960 00000100:00100000:0.0:1789048975.487495:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800576 00000100:00100000:0.0:1789048975.487499:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800576 00000100:00100000:0.0:1789048975.487640:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:0.0:1789048975.487656:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2394:x1875953097800576:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048975.487784:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2394:x1875953097800576:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 132us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.487792:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00080000:0.0:1789048975.488043:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048975.496881:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801472 00000100:00100000:2.0:1789048975.496905:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801472 00000100:00100000:2.0:1789048975.496935:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097800832 00000100:00100000:2.0:1789048975.496938:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097800832 00000100:00100000:2.0:1789048975.496970:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789048975.496983:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097800960:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048975.497087:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:1.0:1789048975.497099:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2394:x1875953097801472:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048975.497112:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097800960:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 133us (43320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048975.497121:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1789048975.497127:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2394:x1875953097801472:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (34340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048975.497133:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789048975.497143:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789048975.497149:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097800832:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048975.497176:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097800832:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (15272us total) trans 0 rc 0/0 00000100:00080000:0.0:1789048975.497209:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048975.497215:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789048975.497308:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048975.497359:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801088 00000100:00100000:0.0:1789048975.497364:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801088 00000100:00100000:0.0:1789048975.497406:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789048975.497413:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2394:x1875953097801088:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048975.497447:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2394:x1875953097801088:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.497453:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00080000:0.0:1789048975.497474:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789048975.500800:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:0.0:1789048975.501108:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048975.501948:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801344 00000100:00100000:2.0:1789048975.501963:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801344 00000100:00100000:2.0:1789048975.502043:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789048975.502054:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2394:x1875953097801344:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789048975.502171:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2394:x1875953097801344:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 117us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048975.502178:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00080000:0.0:1789048975.502595:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789048975.845678:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111551744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789048975.845798:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.846675:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551744 00000100:00100000:2.0:1789048975.847086:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551744 00000100:00100000:2.0:1789048975.849531:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789048975.849560:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111551744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048975.849736:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048975.849871:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111551744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 321us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048975.849879:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789048975.850599:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b0747ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111551744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048975.855521:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789048975.855568:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111551872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048975.855677:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048975.858071:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111551872 00000100:00100000:2.0:1789048975.858096:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111551872 00000100:00100000:2.0:1789048975.858477:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789048975.858492:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111551872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789048975.858769:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789048975.860172:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111551872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1676us (4487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048975.860188:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789048975.865469:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111551872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789048975.886411:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048975.887317:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801600 00000100:00100000:3.0:1789048975.887369:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801600 00000100:00100000:3.0:1789048975.887441:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789048975.887452:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:18747:x1875953097801600:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048975.887480:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048975.887520:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29da7 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887642:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887661:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887681:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887702:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887709:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887717:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887826:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837a00/0x133f221c08777e3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887834:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837a00/0x133f221c08777e3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.887842:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837a00/0x133f221c08777e3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048975.887899:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048975.887903:0:22706:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048975.887965:0:22706:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837a00/0x133f221c08777e3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889645:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889655:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889666:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889673:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048975.889679:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889688:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889708:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:3.0:1789048975.889712:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048975.889718:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889726:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889748:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889755:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889761:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889774:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048975.889778:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889785:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889795:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff959c11777800) 00010000:00010000:3.0:1789048975.889798:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048975.889801:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889808:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889888:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29da7 expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889907:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837a00/0x133f221c08777e3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29da7 expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.889914:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c11777100) 00010000:00010000:3.0:1789048975.889917:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048975.889920:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837a00, rc 0) 00000100:00100000:2.0:1789048975.891028:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+7:18747:x1875953097801600:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 3567us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048975.891042:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789048975.897757:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048975.898671:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801728 00000100:00100000:3.0:1789048975.898685:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801728 00000100:00100000:3.0:1789048975.898776:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:3.0:1789048975.898790:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ab02f1da-990a-440f-8505-d0174933fc99+7:18747:x1875953097801728:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789048975.898965:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ab02f1da-990a-440f-8505-d0174933fc99+7:18747:x1875953097801728:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 179us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048975.898983:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1789048975.910080:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048975.910994:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097801984 00000100:00100000:2.0:1789048975.911009:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097801984 00000100:00100000:2.0:1789048975.911089:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789048975.911100:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+7:18747:x1875953097801984:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048975.911139:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048975.911169:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777e45 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dae expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911290:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911310:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911326:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911384:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911392:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911400:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911548:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777e5a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911566:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777e5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911574:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777e5a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048975.911585:0:22704:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789048975.911784:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911801:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911809:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911817:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048975.911823:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911831:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911844:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff959c11777100) 00010000:00010000:2.0:1789048975.911848:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048975.911853:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911860:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c08777e4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911876:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911882:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911888:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911893:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048975.911900:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911906:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911914:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff959c4152a100) 00010000:00010000:2.0:1789048975.911917:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048975.911919:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.911926:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c08777e53 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.913797:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08777e45 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dae expref: 10 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.913827:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061c00/0x133f221c08777e5a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dae expref: 9 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048975.913836:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c4152af00) 00010000:00010000:2.0:1789048975.913839:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048975.913842:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061c00, rc 0) 00000100:00100000:2.0:1789048975.913930:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:18747:x1875953097801984:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 2832us (3864us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789048975.913940:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789048975.923645:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048975.923769:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097802112 00000100:00100000:0.0:1789048975.923781:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097802112 00000100:00100000:0.0:1789048975.923872:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048975.923884:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+9:18747:x1875953097802112:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789048975.924032:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+9:18747:x1875953097802112:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 151us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048975.924041:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048975.930235:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048975.930416:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097802240 00000100:00100000:2.0:1789048975.930429:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097802240 00000100:00100000:2.0:1789048975.930504:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:2.0:1789048975.930526:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+5:18747:x1875953097802240:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1789048975.932153:0:22705:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1542us 00000100:00100000:2.0:1789048975.983626:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048975.983728:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097802368 00000100:00100000:3.0:1789048975.983742:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097802368 00000100:00100000:3.0:1789048975.983819:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789048975.983832:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+9:18753:x1875953097802368:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048975.983874:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048975.983904:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29db5 expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.983994:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984013:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984029:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984291:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984300:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984309:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984390:0:25241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984416:0:25241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984424:0:25241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984431:0:25241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048975.984438:0:25241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984448:0:25241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984462:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:3.0:1789048975.984466:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048975.984473:0:25241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984480:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777e6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984500:0:25241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984518:0:25241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984525:0:25241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984531:0:25241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048975.984540:0:25241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984548:0:25241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984762:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff959c11777800) 00010000:00010000:3.0:1789048975.984766:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048975.984771:0:25241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984778:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984823:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e68 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29db5 expref: 10 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984901:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:3.0:1789048975.984905:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048975.984910:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29db5 expref: 10 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048975.984922:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837600, rc 0) 00000100:00100000:3.0:1789048975.985020:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+9:18753:x1875953097802368:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1189us (1406us total) trans 0 rc 301/301 00000100:00100000:3.0:1789048975.985030:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1789048975.990147:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048975.990275:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097802496 00000100:00100000:3.0:1789048975.990289:0:22713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097802496 00000100:00100000:3.0:1789048975.990377:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789048975.990390:0:22713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ab02f1da-990a-440f-8505-d0174933fc99+9:18753:x1875953097802496:12345-192.168.202.16@tcp:700:lfs.0 00000100:00100000:3.0:1789048975.990497:0:22713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ab02f1da-990a-440f-8505-d0174933fc99+9:18753:x1875953097802496:12345-192.168.202.16@tcp:700:lfs.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048975.990518:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789048975.992313:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048975.992411:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097802752 00000100:00100000:0.0:1789048975.992422:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097802752 00000100:00100000:0.0:1789048975.992485:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789048975.992496:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:18753:x1875953097802752:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1789048975.992576:0:22704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048975.992610:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777d96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d22 expref: 9 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.992633:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:0.0:1789048975.992639:0:22704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048975.992728:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.992745:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 5 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.992754:0:22704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.993074:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 5 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048975.993101:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 5 pid: 25241 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048975.993119:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111552000:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048975.993441:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d16cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789048976.000484:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048976.000545:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097802880 00000100:00100000:1.0:1789048976.000557:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097802880 00010000:00010000:1.0:1789048976.000611:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 6 pid: 25241 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048976.000657:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789048976.000669:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2394:x1875953097802880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048976.000691:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048976.000699:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 6 pid: 25241 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.000740:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 6 pid: 25241 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.000768:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:1.0:1789048976.000776:0:22691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.000789:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.000809:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.000837:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048976.000909:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2394:x1875953097802880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 242us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.000917:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:0.0:1789048976.002714:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+5:18747:x1875953097802240:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 72178us (72482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048976.002731:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00010000:00010000:3.0:1789048976.002990:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777dd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29d92 expref: 5 pid: 25241 timeout: 830 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048976.003012:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111552000:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048976.003040:0:22704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.003091:0:22704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.003100:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.003128:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.003143:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.003155:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.009447:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.009480:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.009514:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048976.010165:0:22704:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f4429bb0 reply state 00000000bcb58667 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010184:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010193:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:3.0:1789048976.010197:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048976.010202:0:22704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789048976.010211:0:22704:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789048976.010222:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010230:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010238:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010243:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.010248:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010256:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010268:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c02b93a00) 00010000:00010000:3.0:1789048976.010270:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048976.010283:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.010290:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777e7d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048976.011055:0:22704:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f4429bb0 reply state 00000000bcb58667 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.011073:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.011147:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff959c11777800) 00010000:00010000:3.0:1789048976.011150:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048976.011153:0:22704:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789048976.011302:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+10:18753:x1875953097802752:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 18801us (18992us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789048976.011666:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00010000:00010000:0.0:1789048976.029584:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048976.107801:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.114312:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097803008 00000100:00100000:3.0:1789048976.114328:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097803008 00000100:00100000:3.0:1789048976.114426:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789048976.114436:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+10:18761:x1875953097803008:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:3.0:1789048976.114459:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048976.114481:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dbc expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.114791:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.114809:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.114843:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048976.114891:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048976.114895:0:25241:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048976.115089:0:25241:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.115113:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dbc expref: 12 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.115133:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836600/0x133f221c08777e99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dbc expref: 11 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.115141:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:3.0:1789048976.115144:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048976.115147:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836600, rc 0) 00000100:00100000:3.0:1789048976.116845:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+11:18761:x1875953097803008:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 2401us (9046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.116857:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048976.164101:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.164193:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097803136 00000100:00100000:0.0:1789048976.164203:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097803136 00000100:00100000:0.0:1789048976.164265:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789048976.164276:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:18762:x1875953097803136:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048976.164295:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048976.164316:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dc3 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.164425:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.164440:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.164451:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048976.164521:0:22705:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048976.164525:0:22705:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048976.164548:0:22705:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.164582:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dc3 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.164601:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38e00/0x133f221c08777ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dc3 expref: 6 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.164609:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:0.0:1789048976.164613:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789048976.164617:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38e00, rc 0) 00000100:00100000:0.0:1789048976.164690:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18762:x1875953097803136:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 416us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048976.164698:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048976.167672:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.167925:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097803264 00000100:00100000:3.0:1789048976.167938:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097803264 00000100:00100000:3.0:1789048976.168018:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789048976.168030:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+6:18762:x1875953097803264:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048976.168056:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048976.168081:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dca expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168192:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168210:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168226:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168239:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168247:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168255:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168388:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ec3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168397:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ec3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168404:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ec3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048976.168451:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048976.168455:0:22706:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048976.168757:0:22706:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ec3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168784:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168792:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168799:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168806:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.168811:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168818:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168831:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:3.0:1789048976.168835:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048976.168840:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168846:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168862:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168869:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168874:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168886:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.168889:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168894:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168902:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff959c11777800) 00010000:00010000:3.0:1789048976.168905:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048976.168908:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168913:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ebc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168948:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dca expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168962:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ec3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dca expref: 7 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.168970:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:3.0:1789048976.168972:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048976.168974:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836e00, rc 0) 00000100:00100000:3.0:1789048976.169057:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+7:18762:x1875953097803264:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1028us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.169067:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789048976.172290:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.172965:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097803392 00000100:00100000:3.0:1789048976.172998:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097803392 00000100:00100000:3.0:1789048976.173074:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789048976.173087:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:18762:x1875953097803392:12345-192.168.202.16@tcp:900:lfs.0 00000100:00100000:3.0:1789048976.173261:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:18762:x1875953097803392:12345-192.168.202.16@tcp:900:lfs.0 Request processed in 177us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.173270:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:2.0:1789048976.189940:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.190057:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097803648 00000100:00100000:0.0:1789048976.190070:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097803648 00000100:00100000:0.0:1789048976.190143:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048976.190156:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+7:18762:x1875953097803648:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048976.190183:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048976.190210:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777eca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dd1 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048976.190422:0:22705:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789048976.190585:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777eca lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dd1 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.190614:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:0.0:1789048976.190618:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789048976.190624:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777eca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dd1 expref: 9 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.190640:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38600, rc 0) 00000100:00100000:0.0:1789048976.190715:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+8:18762:x1875953097803648:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 562us (791us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789048976.190724:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789048976.207080:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.207240:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097803904 00000100:00100000:0.0:1789048976.207253:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097803904 00000100:00100000:0.0:1789048976.207380:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789048976.207393:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+8:18762:x1875953097803904:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1789048976.207480:0:25241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048976.207545:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ec3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dca expref: 8 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.207798:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:0.0:1789048976.207804:0:25241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048976.207840:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.207858:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.207872:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048976.213234:0:25241:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000b83e4bbc reply state 00000000c79c0b4e transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.213272:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.213283:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:0.0:1789048976.213287:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789048976.213292:0:25241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789048976.213306:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789048976.214014:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33100e65-e304-4913-82a7-bb107e2e9bbb+9:18762:x1875953097803904:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 6615us (6940us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789048976.214027:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:2.0:1789048976.220305:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.221009:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097804160 00000100:00100000:3.0:1789048976.221022:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097804160 00000100:00100000:3.0:1789048976.221104:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789048976.221115:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+9:18762:x1875953097804160:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048976.222016:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+10:18762:x1875953097804160:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 897us (1722us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789048976.222031:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789048976.226241:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.226375:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097804416 00000100:00100000:0.0:1789048976.226389:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097804416 00000100:00100000:3.0:1789048976.226707:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789048976.226725:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+10:18762:x1875953097804416:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048976.226760:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048976.226790:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777edf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dd8 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.226901:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.226920:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.226935:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.226947:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.226954:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.226981:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048976.227126:0:22704:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789048976.227224:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227233:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227241:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227248:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.227253:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227262:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227275:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:3.0:1789048976.227279:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048976.227285:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227291:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777ee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227311:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227327:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227392:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.227399:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.227402:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.228256:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.228271:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff959c11777800) 00010000:00010000:3.0:1789048976.228274:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048976.228278:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.228284:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777eed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.228380:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777edf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dd8 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.228392:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:3.0:1789048976.228394:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048976.228399:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777edf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dd8 expref: 12 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.228727:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836a00, rc 0) 00000100:00100000:2.0:1789048976.228975:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+11:18762:x1875953097804416:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2253us (2745us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1789048976.228987:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:1.0:1789048976.232783:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.232880:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097804544 00000100:00100000:3.0:1789048976.232894:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097804544 00000100:00100000:3.0:1789048976.232971:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:3.0:1789048976.232984:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+11:18762:x1875953097804544:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048976.233016:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048976.233042:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777efb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29ddf expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.233160:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.233177:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.233193:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048976.233226:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789048976.233230:0:22706:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048976.233257:0:22706:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.233289:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777efb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.233311:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.233392:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:3.0:1789048976.233396:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789048976.233400:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02837c00, rc 0) 00000100:00100000:3.0:1789048976.233678:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33100e65-e304-4913-82a7-bb107e2e9bbb+12:18762:x1875953097804544:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 696us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.233686:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:3.0:1789048976.237782:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048976.237935:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097804672 00000100:00100000:1.0:1789048976.237950:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097804672 00000100:00100000:1.0:1789048976.238024:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789048976.238037:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+12:18762:x1875953097804672:12345-192.168.202.16@tcp:37:lfs.0 00000100:00100000:2.0:1789048976.245974:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+12:18762:x1875953097804672:12345-192.168.202.16@tcp:37:lfs.0 Request processed in 7924us (8191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048976.245992:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:2.0:1789048976.251167:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.251415:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097804928 00000100:00100000:0.0:1789048976.251428:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097804928 00000100:00100000:0.0:1789048976.251518:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789048976.251531:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+12:18762:x1875953097804928:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048976.252017:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb39c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+13:18762:x1875953097804928:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 487us (865us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789048976.252026:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:3.0:1789048976.308283:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.308453:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097805056 00000100:00100000:0.0:1789048976.308464:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097805056 00000100:00100000:0.0:1789048976.308578:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:0.0:1789048976.308591:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+11:18768:x1875953097805056:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048976.308618:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048976.308662:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29de6 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308748:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308765:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308781:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308792:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308800:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308807:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308913:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777f1e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308921:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777f1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.308928:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777f1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048976.308969:0:22705:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789048976.308972:0:22705:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048976.309017:0:22705:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777f1e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309036:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309044:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309052:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309058:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048976.309062:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309070:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309084:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:0.0:1789048976.309087:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048976.309092:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309099:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309114:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309120:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309127:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309136:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048976.309139:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309145:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309151:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff959c11777800) 00010000:00010000:0.0:1789048976.309154:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048976.309156:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309162:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309188:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29de6 expref: 13 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309202:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38400/0x133f221c08777f1e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29de6 expref: 12 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.309208:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:0.0:1789048976.309211:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789048976.309213:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38400, rc 0) 00000100:00100000:0.0:1789048976.309298:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+12:18768:x1875953097805056:12345-192.168.202.16@tcp:101:bash.0 Request processed in 710us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048976.309307:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:1.0:1789048976.314161:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.314264:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097805184 00000100:00100000:3.0:1789048976.314278:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097805184 00000100:00100000:3.0:1789048976.314387:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789048976.314401:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ab02f1da-990a-440f-8505-d0174933fc99+5:18768:x1875953097805184:12345-192.168.202.16@tcp:900:bash.0 00000100:00100000:3.0:1789048976.314541:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ab02f1da-990a-440f-8505-d0174933fc99+5:18768:x1875953097805184:12345-192.168.202.16@tcp:900:bash.0 Request processed in 143us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.314551:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789048976.318136:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.318374:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097805440 00000100:00100000:3.0:1789048976.318387:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097805440 00000100:00100000:3.0:1789048976.318454:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:3.0:1789048976.318465:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+12:18768:x1875953097805440:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048976.318490:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048976.318531:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f25 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29ded expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.318814:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.318855:0:22706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.318865:0:22706:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.318904:0:22706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.318927:0:22706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 12 pid: 22706 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048976.318943:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22706:1875953111552128:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048976.319092:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18cef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789048976.326739:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048976.326858:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097805568 00000100:00100000:1.0:1789048976.326887:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097805568 00010000:00010000:1.0:1789048976.326940:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 13 pid: 22706 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048976.327019:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:1.0:1789048976.327031:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+13:2393:x1875953097805568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048976.327058:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048976.327066:0:22689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 13 pid: 22706 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.327091:0:22689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 13 pid: 22706 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.327116:0:22689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:1.0:1789048976.327122:0:22689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.327134:0:22689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.327143:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.327164:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048976.327243:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+13:2393:x1875953097805568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 214us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.327251:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00010000:00010000:3.0:1789048976.328689:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777f02 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ddf expref: 12 pid: 22706 timeout: 831 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048976.328720:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b613b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22706:1875953111552128:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048976.328750:0:22706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.328761:0:22706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.328767:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.333853:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.333895:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.333911:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.334937:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.334951:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.334959:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048976.334971:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789048976.334998:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335006:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335012:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335018:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.335022:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335029:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335060:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:3.0:1789048976.335063:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048976.335069:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335075:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f2c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789048976.335090:0:22706:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000014ec9a9d reply state 00000000eb3b96b5 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335101:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335107:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff959c11777900) 00010000:00010000:3.0:1789048976.335109:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048976.335112:0:22706:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789048976.335549:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f25 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 15 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335568:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 14 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.335576:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048976.335579:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789048976.335581:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836400, rc 0) 00000100:00100000:3.0:1789048976.335868:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+15:18768:x1875953097805440:12345-192.168.202.16@tcp:101:bash.0 Request processed in 17402us (17742us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1789048976.335877:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:2.0:1789048976.357931:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.358044:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097805696 00000100:00100000:0.0:1789048976.358074:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097805696 00000100:00100000:0.0:1789048976.358152:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:0.0:1789048976.358163:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+15:18768:x1875953097805696:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048976.358212:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048976.358241:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f48 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29df4 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358383:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358401:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358415:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048976.358480:0:22705:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789048976.358485:0:22705:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048976.358521:0:22705:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358534:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358574:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f48 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29df4 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358598:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29df4 expref: 16 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.358607:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048976.358618:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048976.358623:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048976.358693:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+16:18768:x1875953097805696:12345-192.168.202.16@tcp:101:bash.0 Request processed in 531us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048976.358701:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:1.0:1789048976.364835:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048976.366398:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097805952 00000100:00100000:2.0:1789048976.366417:0:22707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097805952 00000100:00100000:2.0:1789048976.366491:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:2.0:1789048976.366512:0:22707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab02f1da-990a-440f-8505-d0174933fc99+16:18768:x1875953097805952:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:2.0:1789048976.367008:0:22707:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:2.0:1789048976.367790:0:22707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab02f1da-990a-440f-8505-d0174933fc99+18:18768:x1875953097805952:12345-192.168.202.16@tcp:35:bash.0 Request processed in 1283us (2964us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1789048976.367817:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000020:00080000:2.0:1789048976.367824:0:22707:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789048976.495990:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.496185:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097806208 00000100:00100000:0.0:1789048976.496199:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097806208 00000100:00100000:0.0:1789048976.496320:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:0.0:1789048976.496380:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+18:18778:x1875953097806208:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048976.496416:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048976.496443:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29dfb expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048976.496909:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789048976.497057:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dfb expref: 20 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048976.497074:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:2.0:1789048976.497078:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048976.497084:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29dfb expref: 20 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048976.497104:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:2.0:1789048976.497182:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+19:18778:x1875953097806208:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 851us (1205us total) trans 12884901899 rc 301/301 00000100:00100000:2.0:1789048976.497191:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:3.0:1789048976.505477:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.505775:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097806464 00000100:00100000:0.0:1789048976.505788:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097806464 00000100:00100000:0.0:1789048976.505871:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:0.0:1789048976.505884:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+19:18778:x1875953097806464:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048976.506192:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+20:18778:x1875953097806464:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 310us (729us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789048976.506201:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000040:00080000:0.0:1789048976.542770:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789048976.581446:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048976.581665:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097806720 00000100:00100000:0.0:1789048976.581683:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097806720 00000100:00100000:0.0:1789048976.581766:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:0.0:1789048976.581779:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+20:18781:x1875953097806720:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789048976.581817:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048976.581858:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777f64 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e02 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.582021:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f6b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.582049:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.582066:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048976.582080:0:22705:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789048976.582218:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777f64 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e02 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.582242:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f6b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e02 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048976.582252:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048976.582255:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048976.582259:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:0.0:1789048976.582399:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+22:18781:x1875953097806720:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 622us (970us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1789048976.582407:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:1.0:1789048976.598738:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.598833:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097806848 00000100:00100000:3.0:1789048976.598843:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097806848 00000100:00100000:3.0:1789048976.598913:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789048976.598923:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+22:18781:x1875953097806848:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:3.0:1789048976.598986:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599002:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599013:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599046:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599052:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599058:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599064:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048976.599068:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599075:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599085:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048976.599087:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048976.599118:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048976.599124:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f79 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048976.599198:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+22:18781:x1875953097806848:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 276us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.599205:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789048976.600526:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048976.604658:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048976.605087:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097807232 00000100:00100000:2.0:1789048976.605096:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097807232 00000100:00100000:2.0:1789048976.605159:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789048976.605170:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+22:18781:x1875953097807232:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789048976.605446:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+23:18781:x1875953097807232:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 276us (795us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789048976.605455:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789048976.607667:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097806976 00000100:00100000:0.0:1789048976.607679:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097806976 00000100:00100000:1.0:1789048976.607838:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789048976.607848:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+23:2392:x1875953097806976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048976.607863:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048976.607885:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777f6b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e02 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048976.607907:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048976.607912:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048976.607970:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+22:2392:x1875953097806976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 123us (7447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.607977:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789048976.865444:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111552256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789048976.865529:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.865931:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111552384:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.865966:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.865996:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111552896:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866018:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866035:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866054:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866069:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789048976.866086:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111552768:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866105:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866117:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111553280:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866133:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866143:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111553792:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866174:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866195:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111552640:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866216:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866228:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111553152:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866244:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866268:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111553664:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866285:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866295:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789048976.866299:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111552512:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866316:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866328:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111553024:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866369:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866383:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111553536:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866399:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.866421:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111552384 00000100:00100000:1.0:1789048976.866428:0:22697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111552384 00000100:00100000:1.0:1789048976.866469:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789048976.866478:0:22697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3621:x1875953111552384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.866537:0:22697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c488850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3621:x1875953111552384:12345-0@lo:400:kworker.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.866544:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789048976.866975:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111552896 00000100:00100000:1.0:1789048976.866981:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111552896 00000100:00100000:1.0:1789048976.867001:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111552512 00000100:00100000:1.0:1789048976.867003:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111552512 00000100:00100000:1.0:1789048976.867015:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048976.867029:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111552896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.867068:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111552896:12345-0@lo:400:kworker.0 Request processed in 40us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.867137:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789048976.867151:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048976.867157:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111552512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.867194:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111552512:12345-0@lo:400:kworker.0 Request processed in 38us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.867201:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789048976.867235:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111552512:0@lo:400:kworker.0 00000100:00100000:3.0:1789048976.867371:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553408 00000100:00100000:3.0:1789048976.867375:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553408 00000100:00100000:3.0:1789048976.867406:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111552768 00000100:00100000:3.0:1789048976.867409:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111552768 00000100:00100000:3.0:1789048976.867420:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553280 00000100:00100000:3.0:1789048976.867422:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553280 00000100:00100000:3.0:1789048976.867432:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553792 00000100:00100000:3.0:1789048976.867435:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553792 00000100:00100000:3.0:1789048976.867445:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553664 00000100:00100000:3.0:1789048976.867447:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553664 00000100:00100000:3.0:1789048976.867457:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553536 00000100:00100000:3.0:1789048976.867459:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553536 00000100:00100000:3.0:1789048976.867471:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789048976.867476:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111553408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048976.867519:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111553408:12345-0@lo:400:kworker.0 Request processed in 43us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.867526:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789048976.867538:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789048976.867543:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111552768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048976.867591:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111552768:12345-0@lo:400:kworker.0 Request processed in 47us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.867597:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789048976.867608:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789048976.867613:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111553280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048976.867641:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875953111553280:12345-0@lo:400:kworker.0 Request processed in 28us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.867646:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789048976.867656:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048976.867662:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111553792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048976.867686:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875953111553792:12345-0@lo:400:kworker.0 Request processed in 25us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.867692:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789048976.867702:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789048976.867707:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111553664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.867787:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111552768:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.867798:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875953111553280:0@lo:400:kworker.0 00010000:00080000:1.0:1789048976.867810:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080d9180 x1875953111553792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789048976.867819:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3621:1875953111553792:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.867828:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111552384:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.870253:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111552896:0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.870301:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111553408:0@lo:400:kworker.0 00000100:00100000:2.0:1789048976.870566:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111552640 00000100:00100000:2.0:1789048976.870573:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111552640 00000100:00100000:2.0:1789048976.870633:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553152 00000100:00100000:2.0:1789048976.870636:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553152 00000100:00100000:2.0:1789048976.870649:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553024 00000100:00100000:2.0:1789048976.870652:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553024 00000100:00100000:2.0:1789048976.870670:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789048976.870678:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111552640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048976.870773:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3958ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111553920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048976.870809:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048976.870861:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111552256 00000100:00100000:1.0:1789048976.870865:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111552256 00000100:00100000:1.0:1789048976.870899:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111553920 00000100:00100000:1.0:1789048976.870901:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111553920 00000100:00100000:1.0:1789048976.870911:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048976.870917:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111552256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789048976.870938:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048976.870970:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111552256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (5441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.870976:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789048976.870993:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048976.870999:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111553920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789048976.871011:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789048976.871038:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1875953111553920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.871044:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789048976.871072:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3958ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111553920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048976.871123:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048976.871130:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111553152:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789048976.871212:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048976.871217:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789048976.871219:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048976.871221:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789048976.871245:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789048976.871254:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111553536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048976.881065:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111552640:12345-0@lo:400:kworker.0 Request processed in 10376us (14836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048976.881089:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789048976.881125:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048976.881141:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111553024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789048976.881231:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111553024:12345-0@lo:400:kworker.0 Request processed in 99us (14862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048976.881237:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789048976.881325:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111553024:0@lo:400:kworker.0 00000100:00100000:3.0:1789048976.881396:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875953111553664:12345-0@lo:400:kworker.0 Request processed in 13687us (15107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048976.881405:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789048976.881475:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111552256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048976.894531:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111553152:12345-0@lo:400:kworker.0 Request processed in 23391us (28274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048976.894954:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789048976.895224:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875953111553536:12345-0@lo:400:kworker.0 Request processed in 23968us (28819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048976.895234:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789048976.905237:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b080da300 x1875953111553536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048976.905255:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3623:1875953111553536:0@lo:400:kworker.0 00000100:00100000:2.0:1789048976.905271:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111552640:0@lo:400:kworker.0 00000100:00100000:2.0:1789048976.905282:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111553152:0@lo:400:kworker.0 00000100:00100000:2.0:1789048976.905292:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3623:1875953111553664:0@lo:400:kworker.0 00000040:00080000:1.0:1789048976.989943:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789048977.000475:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048977.000560:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097807488 00000100:00100000:0.0:1789048977.000570:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097807488 00000100:00100000:0.0:1789048977.000652:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:0.0:1789048977.000664:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+22:18812:x1875953097807488:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:0.0:1789048977.000689:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048977.000711:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777f80 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e09 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789048977.000714:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789048977.000818:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f87 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048977.000847:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048977.000859:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048977.000872:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789048977.000997:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777f80 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e09 expref: 25 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048977.001020:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e09 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048977.001053:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048977.001056:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048977.001061:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39c00, rc 0) 00000100:00100000:0.0:1789048977.001181:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+24:18812:x1875953097807488:12345-192.168.202.16@tcp:101:cat.0 Request processed in 519us (713us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789048977.001189:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1789048977.022612:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048977.022676:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048977.022830:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097807744 00000100:00100000:0.0:1789048977.022840:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097807744 00000100:00100000:0.0:1789048977.022912:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1789048977.022922:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+24:18812:x1875953097807744:12345-192.168.202.16@tcp:35:cat.0 00000001:00080000:0.0:1789048977.023173:0:22708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901904 00000100:00100000:0.0:1789048977.023289:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+26:18812:x1875953097807744:12345-192.168.202.16@tcp:35:cat.0 Request processed in 368us (686us total) trans 12884901905 rc 0/0 00000100:00100000:0.0:1789048977.023297:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000020:00080000:0.0:1789048977.023302:0:22708:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789048977.023495:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097807872 00000100:00100000:1.0:1789048977.023512:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097807872 00000100:00100000:1.0:1789048977.023564:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1789048977.023572:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab02f1da-990a-440f-8505-d0174933fc99+26:2394:x1875953097807872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048977.023585:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048977.023618:0:24236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777f87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e09 expref: 26 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048977.023638:0:24236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048977.023643:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048977.023666:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab02f1da-990a-440f-8505-d0174933fc99+25:2394:x1875953097807872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 95us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048977.023672:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00010000:00010000:1.0:1789048977.055176:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789048977.206784:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048977.206949:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097808128 00000100:00100000:3.0:1789048977.206959:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097808128 00000100:00100000:3.0:1789048977.207019:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:3.0:1789048977.207030:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+25:18818:x1875953097808128:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1789048977.207052:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048977.207079:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f95 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e10 expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.207183:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.207196:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.207207:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048977.207219:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789048977.207330:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777f95 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e10 expref: 28 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.207400:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e10 expref: 27 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.207409:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048977.207413:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048977.207417:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836800, rc 0) 00000100:00100000:3.0:1789048977.207474:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+27:18818:x1875953097808128:12345-192.168.202.16@tcp:101:dd.0 Request processed in 446us (699us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1789048977.207482:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1789048977.238418:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048977.238554:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048977.238649:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097808384 00000100:00100000:1.0:1789048977.238659:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097808384 00000100:00100000:1.0:1789048977.238732:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789048977.238742:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+27:2393:x1875953097808384:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048977.238758:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048977.238781:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777f9c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e10 expref: 27 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048977.238803:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048977.238808:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048977.238881:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+26:2393:x1875953097808384:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048977.238888:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789048977.247322:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097808256 00000100:00100000:3.0:1789048977.248060:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097808256 00000100:00100000:2.0:1789048977.248254:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789048977.248264:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+26:18818:x1875953097808256:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789048977.248287:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048977.248311:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c08777faa lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e17 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048977.248373:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048977.248387:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048977.248401:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048977.248529:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c08777faa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 28 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048977.248563:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 27 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048977.248573:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:2.0:1789048977.248576:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789048977.248580:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060c00, rc 0) 00000100:00100000:2.0:1789048977.248645:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+27:18818:x1875953097808256:12345-192.168.202.16@tcp:101:dd.0 Request processed in 382us (10237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048977.248651:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789048977.256115:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048977.256729:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097808640 00000100:00100000:3.0:1789048977.256739:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097808640 00000100:00100000:3.0:1789048977.256791:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:3.0:1789048977.256813:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+27:18818:x1875953097808640:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:3.0:1789048977.256889:0:25241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048977.256914:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777f4f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29df4 expref: 27 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.256936:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048977.256940:0:25241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789048977.257119:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.257132:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.257141:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048977.257179:0:25241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901907 00000004:00010000:3.0:1789048977.257202:0:25241:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000fa2452e4 reply state 000000007a02e8de transno 12884901908 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.257214:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048977.257220:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048977.257223:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048977.257225:0:25241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048977.257312:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+29:18818:x1875953097808640:12345-192.168.202.16@tcp:36:dd.0 Request processed in 502us (1208us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1789048977.257320:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000020:00080000:3.0:1789048977.257324:0:25241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048977.486597:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048977.486770:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097808896 00000100:00100000:0.0:1789048977.486779:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097808896 00000100:00100000:0.0:1789048977.486846:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789048977.486857:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+29:18818:x1875953097808896:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:0.0:1789048977.487094:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+30:18818:x1875953097808896:12345-192.168.202.16@tcp:35:dd.0 Request processed in 238us (506us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789048977.487101:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789048978.073170:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048978.073281:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097809024 00000100:00100000:0.0:1789048978.073291:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097809024 00000100:00100000:0.0:1789048978.073401:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789048978.073424:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+30:18832:x1875953097809024:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:0.0:1789048978.073453:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048978.073475:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777fbf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e1e expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073572:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073588:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073601:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073612:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073619:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073626:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073707:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073717:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073725:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048978.073774:0:22704:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789048978.073778:0:22704:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048978.073815:0:22704:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073826:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073835:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073841:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073848:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073854:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048978.073858:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073867:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073888:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:0.0:1789048978.073891:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048978.073896:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073903:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08777fc6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073929:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073935:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073940:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073946:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048978.073949:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073955:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073962:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff959c11777900) 00010000:00010000:0.0:1789048978.073964:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048978.073967:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073973:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08777fcd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.073998:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c08777fbf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e1e expref: 32 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.074012:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e1e expref: 31 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.074031:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048978.074033:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048978.074036:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef38000, rc 0) 00000100:00100000:0.0:1789048978.074097:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+31:18832:x1875953097809024:12345-192.168.202.16@tcp:101:stat.0 Request processed in 675us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048978.074104:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00010000:00010000:0.0:1789048978.079736:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048978.242471:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048978.242656:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097809280 00000100:00100000:2.0:1789048978.242667:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097809280 00000100:00100000:2.0:1789048978.242732:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789048978.242753:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+31:18838:x1875953097809280:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:2.0:1789048978.242808:0:25241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048978.242847:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08777fd4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e1e expref: 31 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.242869:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:2.0:1789048978.242875:0:25241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789048978.243048:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.243073:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.243083:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789048978.243127:0:25241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901910 00000004:00010000:2.0:1789048978.243151:0:25241:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000c41b5937 reply state 000000006987d2cd transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.243176:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.243183:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:2.0:1789048978.243200:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789048978.243204:0:25241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789048978.243322:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+33:18838:x1875953097809280:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 570us (860us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1789048978.243330:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000020:00080000:2.0:1789048978.243386:0:25241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789048978.550045:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048978.554975:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097809408 00000100:00100000:3.0:1789048978.554992:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097809408 00000100:00100000:3.0:1789048978.555088:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1789048978.555100:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+33:18852:x1875953097809408:12345-192.168.202.16@tcp:101:stat.0 00010000:00010000:3.0:1789048978.555125:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048978.555147:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777fe2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e25 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555229:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555243:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555257:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555268:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555276:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555282:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555402:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555412:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555440:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048978.555480:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1789048978.555495:0:22706:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789048978.555521:0:22706:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555804:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555825:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555831:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555838:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555843:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836200 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048978.555847:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555854:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555865:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:3.0:1789048978.555868:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048978.555873:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555889:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c08777fe9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555904:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555910:0:22706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555915:0:22706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555919:0:22706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048978.555922:0:22706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555927:0:22706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555935:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff959c11777900) 00010000:00010000:3.0:1789048978.555938:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789048978.555941:0:22706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555946:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08777ff0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.555974:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08777fe2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 35 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.556002:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 34 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.556009:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048978.556012:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789048978.556014:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836e00, rc 0) 00000100:00100000:3.0:1789048978.556104:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+34:18852:x1875953097809408:12345-192.168.202.16@tcp:101:stat.0 Request processed in 1006us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048978.556112:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:3.0:1789048978.793009:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048978.793589:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097809664 00000100:00100000:2.0:1789048978.793601:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097809664 00000100:00100000:2.0:1789048978.793669:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789048978.793680:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+34:18862:x1875953097809664:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789048978.793699:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048978.793720:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c08777ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e2c expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789048978.793816:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789048978.793919:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c08777ffe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e2c expref: 36 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.793934:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:2.0:1789048978.793937:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789048978.793942:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07061000/0x133f221c08777ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e2c expref: 36 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048978.793957:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07061000, rc 0) 00000100:00100000:2.0:1789048978.794018:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+35:18862:x1875953097809664:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 341us (1020us total) trans 12884901912 rc 301/301 00000100:00100000:2.0:1789048978.794025:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:2.0:1789048978.802689:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048978.804739:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097809920 00000100:00100000:0.0:1789048978.804754:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097809920 00000100:00100000:0.0:1789048978.804832:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:0.0:1789048978.804843:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3fb3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+35:18862:x1875953097809920:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789048978.805084:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3fb3b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+36:18862:x1875953097809920:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 243us (2402us total) trans 12884901913 rc 0/0 00000100:00100000:0.0:1789048978.805102:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789048978.985860:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048978.986527:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097810176 00000100:00100000:0.0:1789048978.986539:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097810176 00000100:00100000:0.0:1789048978.986644:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:0.0:1789048978.986655:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+36:18868:x1875953097810176:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048978.986678:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048978.986698:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877800c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e33 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.986803:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.986818:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.986843:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.986852:0:22704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.986886:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.986905:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 37 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048978.986919:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111554048:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048978.987014:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 37 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048978.987023:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 37 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048978.987031:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111554176:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048978.987053:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d16480 going to sleep for 11 seconds 00000100:00100000:2.0:1789048978.991720:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048978.991778:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048978.992209:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097810304 00000100:00100000:3.0:1789048978.992218:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097810304 00010000:00010000:3.0:1789048978.992261:0:24236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 38 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048978.992305:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097810432 00000100:00100000:3.0:1789048978.992309:0:24236:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097810432 00010000:00010000:3.0:1789048978.992324:0:24236:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 39 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048978.992382:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789048978.992392:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a4f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab02f1da-990a-440f-8505-d0174933fc99+39:2393:x1875953097810304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048978.992408:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048978.992413:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 39 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992447:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 39 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992468:0:24236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048978.992473:0:24236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992494:0:24236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992501:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048978.992707:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a4f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab02f1da-990a-440f-8505-d0174933fc99+39:2393:x1875953097810304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 315us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048978.992716:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:3.0:1789048978.992763:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:3.0:1789048978.992771:0:24236:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab02f1da-990a-440f-8505-d0174933fc99+38:2393:x1875953097810432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048978.992779:0:24236:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048978.992784:0:24236:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 38 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992794:0:24236:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 38 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992804:0:24236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048978.992822:0:24236:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992842:0:24236:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992849:0:24236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048978.992867:0:24236:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048978.992887:0:24236:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab02f1da-990a-440f-8505-d0174933fc99+38:2393:x1875953097810432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 117us (1109us total) trans 0 rc 0/0 00010000:00010000:1.0:1789048978.993274:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c08777ff7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e25 expref: 38 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048978.993292:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111554048:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048978.993312:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08777f3a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29ded expref: 37 pid: 22706 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048978.993321:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111554176:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048978.993406:0:22704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048978.993415:0:22704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048978.993421:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048978.993439:0:22704:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1789048978.993876:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877800c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 38 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048978.993893:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 37 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048978.993901:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048978.993904:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789048978.993907:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39c00, rc 0) 00000100:00100000:1.0:1789048978.993941:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+37:18868:x1875953097810176:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7290us (8094us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1789048978.993948:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:3.0:1789048978.994999:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789048979.003641:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.003734:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097810688 00000100:00100000:3.0:1789048979.003746:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097810688 00000100:00100000:3.0:1789048979.003848:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:3.0:1789048979.003861:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+36:18868:x1875953097810688:12345-192.168.202.16@tcp:36:bash.0 00010000:00010000:3.0:1789048979.004111:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.004130:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.004143:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048979.004187:0:25241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000004:00010000:3.0:1789048979.004210:0:25241:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000ae05ced3 reply state 00000000e3349c05 transno 12884901916 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.004224:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.004249:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048979.004253:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789048979.004257:0:25241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789048979.004385:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+39:18868:x1875953097810688:12345-192.168.202.16@tcp:36:bash.0 Request processed in 526us (755us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789048979.004393:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000020:00080000:3.0:1789048979.004397:0:25241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789048979.006852:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789048979.008072:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.008196:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097810816 00000100:00100000:3.0:1789048979.008205:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097810816 00000100:00100000:3.0:1789048979.008262:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:3.0:1789048979.008272:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+39:18868:x1875953097810816:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048979.008290:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048979.008310:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08778028 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e3a expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.008386:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08778028 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e3a expref: 40 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.008401:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08778028 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e3a expref: 40 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.008420:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048979.008423:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789048979.008427:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836800, rc 0) 00000100:00100000:3.0:1789048979.008497:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+40:18868:x1875953097810816:12345-192.168.202.16@tcp:101:bash.0 Request processed in 226us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048979.008504:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:1.0:1789048979.023620:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.023826:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097810944 00000100:00100000:3.0:1789048979.023837:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097810944 00000100:00100000:3.0:1789048979.023901:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789048979.023912:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+40:18868:x1875953097810944:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:3.0:1789048979.023940:0:25241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048979.023963:0:25241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c0877802f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e41 expref: -99 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.024072:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.024088:0:25241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 41 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.024095:0:25241:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.024128:0:25241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 41 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.024147:0:25241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 41 pid: 22704 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048979.024160:0:25241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c2b610380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25241:1875953111554304:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789048979.024236:0:25241:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18cef300 going to sleep for 11 seconds 00000100:00100000:2.0:1789048979.031233:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.031797:0:25241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c2b610380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25241:1875953111554304:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048979.031838:0:25241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.032149:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097811072 00000100:00100000:1.0:1789048979.032158:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097811072 00010000:00010000:1.0:1789048979.032198:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 42 pid: 22704 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.032237:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789048979.032246:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+42:2394:x1875953097811072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048979.032260:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048979.032266:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 42 pid: 22704 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.032284:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 42 pid: 22704 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.032305:0:22691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778013 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e33 expref: 42 pid: 22704 timeout: 833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.032322:0:22691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048979.032327:0:22691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.032389:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.032397:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.032419:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048979.032469:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+41:2394:x1875953097811072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 223us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.032494:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00010000:00010000:0.0:1789048979.032734:0:25241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.032743:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048979.032823:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789048979.032828:0:25241:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048979.032849:0:25241:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.032881:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836200/0x133f221c0877802f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e41 expref: 41 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.032900:0:25241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e41 expref: 40 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.032908:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.032910:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789048979.032913:0:25241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836400, rc 0) 00000100:00100000:0.0:1789048979.032941:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+40:18868:x1875953097810944:12345-192.168.202.16@tcp:101:bash.0 Request processed in 9032us (9331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.032949:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789048979.048006:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.048080:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097811328 00000100:00100000:1.0:1789048979.048090:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097811328 00000100:00100000:1.0:1789048979.048161:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789048979.048172:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab02f1da-990a-440f-8505-d0174933fc99+40:18868:x1875953097811328:12345-192.168.202.16@tcp:103:bash.0 00010000:00010000:1.0:1789048979.048188:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789048979.048212:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c08778028 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e3a expref: 40 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.048236:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836400/0x133f221c08778036 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e41 expref: 39 pid: 25241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.048247:0:22689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048979.048252:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048979.048311:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab02f1da-990a-440f-8505-d0174933fc99+38:18868:x1875953097811328:12345-192.168.202.16@tcp:103:bash.0 Request processed in 141us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.048318:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:0.0:1789048979.056795:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.056934:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097811456 00000100:00100000:3.0:1789048979.056944:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097811456 00000100:00100000:3.0:1789048979.057007:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789048979.057017:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+38:18868:x1875953097811456:12345-192.168.202.16@tcp:58:bash.0 00010000:00010000:3.0:1789048979.057115:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.057132:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.057143:0:22706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048979.058139:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789048979.058173:0:22706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789048979.058409:0:22706:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789048979.058647:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+38:18868:x1875953097811456:12345-192.168.202.16@tcp:58:bash.0 Request processed in 1627us (1857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.058658:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:3.0:1789048979.065712:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.066161:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097811584 00000100:00100000:0.0:1789048979.066171:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097811584 00000100:00100000:0.0:1789048979.066242:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789048979.066253:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+38:18868:x1875953097811584:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048979.066287:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048979.066309:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e48 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.066507:0:22705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.066519:0:22705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 39 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.066548:0:22705:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.066563:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 39 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.066576:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.066579:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789048979.066582:0:22705:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 39 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.066590:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39e00, rc 0) 00000100:00100000:0.0:1789048979.066834:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+39:18868:x1875953097811584:12345-192.168.202.16@tcp:101:bash.0 Request processed in 582us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.066841:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00010000:00010000:0.0:1789048979.109366:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789048979.613607:0:22739:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789048979.613618:0:22739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789048979.613653:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789048979.613662:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789048979.613806:0:22739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22739:1875953111554432:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789048979.613964:0:22739:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d16f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789048979.626084:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.626194:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097811712 00000100:00100000:1.0:1789048979.626216:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097811712 00000100:00100000:1.0:1789048979.626280:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:1.0:1789048979.626299:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+40:18870:x1875953097811712:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789048979.626392:0:22704:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789048979.626514:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+40:18870:x1875953097811712:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 224us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.626522:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789048979.631818:0:22739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22739:1875953111554432:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789048979.645419:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.645683:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097811840 00000100:00100000:0.0:1789048979.645695:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097811840 00000100:00100000:0.0:1789048979.645770:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1789048979.645782:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+39:18870:x1875953097811840:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789048979.645860:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.645877:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.645891:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.645954:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.645962:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.645968:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.645989:0:25241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646013:0:25241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646020:0:25241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048979.646066:0:25241:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789048979.646071:0:25241:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048979.646085:0:25241:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646096:0:25241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646102:0:25241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646108:0:25241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646114:0:25241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.646117:0:25241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646125:0:25241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646136:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c4152af00) 00010000:00010000:0.0:1789048979.646139:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.646144:0:25241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646160:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c0877804b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646176:0:25241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646183:0:25241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646189:0:25241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646194:0:25241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.646197:0:25241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646203:0:25241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646211:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff959c02b93f00) 00010000:00010000:0.0:1789048979.646214:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.646217:0:25241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646223:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778052 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646237:0:25241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646243:0:25241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646254:0:25241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646259:0:25241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.646261:0:25241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646267:0:25241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646274:0:25241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.646276:0:25241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.646278:0:25241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.646283:0:25241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778059 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048979.646408:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+39:18870:x1875953097811840:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 626us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.646416:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:2.0:1789048979.656641:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.657185:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097812096 00000100:00100000:1.0:1789048979.657213:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097812096 00000100:00100000:1.0:1789048979.657287:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789048979.657312:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+39:18870:x1875953097812096:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048979.657385:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048979.657408:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778060 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e4f expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657533:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657548:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657560:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789048979.657572:0:22704:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789048979.657647:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657655:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657661:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657667:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048979.657671:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657679:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657718:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:1.0:1789048979.657721:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789048979.657726:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657732:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c08778067 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657777:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778060 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e4f expref: 41 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657788:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff959c4152af00) 00010000:00010000:1.0:1789048979.657790:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789048979.657794:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778060 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e4f expref: 41 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.657814:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365e00, rc 0) 00000100:00100000:1.0:1789048979.657883:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+40:18870:x1875953097812096:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 577us (1252us total) trans 12884901917 rc 301/301 00000100:00100000:1.0:1789048979.657891:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789048979.665453:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.665556:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097812224 00000100:00100000:0.0:1789048979.665567:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097812224 00000100:00100000:0.0:1789048979.665629:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:0.0:1789048979.665638:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+40:18870:x1875953097812224:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789048979.665672:0:25241:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789048979.665804:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ab02f1da-990a-440f-8505-d0174933fc99+40:18870:x1875953097812224:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.665832:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789048979.684591:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.684678:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097812480 00000100:00100000:1.0:1789048979.684698:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097812480 00000100:00100000:1.0:1789048979.684765:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:1.0:1789048979.684776:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+40:18870:x1875953097812480:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048979.684799:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048979.684833:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778075 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e56 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789048979.685227:0:22704:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1789048979.685233:0:22704:0:(osp_object.c:1650:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1789048979.685254:0:22704:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1789048979.685449:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877807c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.685463:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877807c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.685488:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877807c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.685544:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778075 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e56 expref: 43 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.685563:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877807c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e56 expref: 42 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.685572:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46e00) 00010000:00010000:1.0:1789048979.685574:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789048979.685579:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364a00, rc 0) 00000100:00100000:1.0:1789048979.686020:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+42:18870:x1875953097812480:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1243us (1437us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1789048979.686028:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789048979.698973:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.699072:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097812736 00000100:00100000:0.0:1789048979.699084:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097812736 00000100:00100000:0.0:1789048979.699153:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789048979.699164:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+42:18870:x1875953097812736:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048979.699224:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048979.699250:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877807c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e56 expref: 42 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699270:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46e00) 00010000:00010000:0.0:1789048979.699280:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048979.699312:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699327:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699377:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699393:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699401:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699408:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699479:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699488:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699495:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699501:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.699505:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.699513:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700046:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:0.0:1789048979.700051:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.700057:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700063:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c0877808a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700075:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700082:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700089:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700103:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.700106:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700112:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700121:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xca45275d (ffff959c02b93f00) 00010000:00010000:0.0:1789048979.700123:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.700126:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.700132:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c08778091 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xca45275d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048979.700227:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+41:18870:x1875953097812736:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1064us (1264us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789048979.700236:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:2.0:1789048979.709715:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.709812:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097812864 00000100:00100000:1.0:1789048979.709822:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097812864 00000100:00100000:1.0:1789048979.709880:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:1.0:1789048979.709889:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+41:18870:x1875953097812864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048979.709919:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048979.709940:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778098 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e5d expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.709972:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877809f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.709986:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877809f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.709997:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877809f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.710104:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c08778098 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e5d expref: 43 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.710122:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364a00/0x133f221c0877809f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e5d expref: 42 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.710131:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:1.0:1789048979.710134:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789048979.710138:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08364a00, rc 0) 00000100:00100000:1.0:1789048979.710194:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+42:18870:x1875953097812864:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 307us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.710201:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:2.0:1789048979.723662:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.724931:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097813120 00000100:00100000:0.0:1789048979.724947:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097813120 00000100:00100000:0.0:1789048979.725022:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:0.0:1789048979.725033:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+42:18870:x1875953097813120:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048979.725128:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.725148:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.725162:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789048979.725403:0:22705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1789048979.725415:0:22705:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 734479081074ns, next at 735479078787ns, rc = 0 00000004:00010000:0.0:1789048979.725467:0:22705:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000001e51c070 reply state 00000000bfbe341a transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.725493:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.725500:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:0.0:1789048979.725503:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789048979.725507:0:22705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048979.725628:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+44:18870:x1875953097813120:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 596us (1976us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1789048979.725637:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:2.0:1789048979.730314:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.730457:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097813248 00000100:00100000:1.0:1789048979.730467:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097813248 00000100:00100000:1.0:1789048979.730543:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1789048979.730553:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+44:18870:x1875953097813248:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789048979.730597:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789048979.730618:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e64 expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.730673:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 45 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.730688:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 45 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.730720:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:1.0:1789048979.730723:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789048979.730726:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959b08365e00, rc 0) 00000100:00100000:1.0:1789048979.730786:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+45:18870:x1875953097813248:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 234us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.730793:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:2.0:1789048979.735245:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.739211:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097813376 00000100:00100000:0.0:1789048979.739229:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097813376 00000100:00100000:0.0:1789048979.739385:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789048979.739400:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+5:2394:x1875953097813376:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789048979.739676:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0795aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+6:2394:x1875953097813376:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 281us (4440us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1789048979.739685:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00080000:2.0:1789048979.741382:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789048979.753443:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.753553:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097813632 00000100:00100000:0.0:1789048979.753563:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097813632 00000100:00100000:0.0:1789048979.753624:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789048979.753635:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+45:18870:x1875953097813632:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789048979.753939:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+46:18870:x1875953097813632:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 305us (504us total) trans 12884901920 rc 0/0 00000100:00100000:0.0:1789048979.753955:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1789048979.776217:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.776634:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097813888 00000100:00100000:0.0:1789048979.776644:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097813888 00000100:00100000:0.0:1789048979.776708:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789048979.776718:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+46:18870:x1875953097813888:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789048979.776845:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+46:18870:x1875953097813888:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 128us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.776853:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:1.0:1789048979.788452:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.788919:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097814016 00000100:00100000:0.0:1789048979.788929:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097814016 00000100:00100000:0.0:1789048979.788995:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:0.0:1789048979.789006:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+46:18870:x1875953097814016:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789048979.789030:0:22704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048979.789052:0:22704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780b4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e6b expref: -99 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.789125:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780bb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.789140:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.789154:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789048979.789201:0:22704:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789048979.789222:0:22704:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.789264:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780b4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e6b expref: 48 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.789284:0:22704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e6b expref: 47 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.789292:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:0.0:1789048979.789295:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789048979.789299:0:22704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048979.789600:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+47:18870:x1875953097814016:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 593us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.789608:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:2.0:1789048979.806009:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.806188:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097814144 00000100:00100000:3.0:1789048979.806198:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097814144 00000100:00100000:3.0:1789048979.806259:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:3.0:1789048979.806269:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab02f1da-990a-440f-8505-d0174933fc99+6:2393:x1875953097814144:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789048979.806289:0:24209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048979.806309:0:24209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e72 expref: -99 pid: 24209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789048979.806825:0:24209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fa919e1b2580, blocks: 0x0 00010000:00010000:2.0:1789048979.807088:0:24209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=734s v=(0 0) 00010000:00010000:2.0:1789048979.807093:0:24209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048979.807103:0:24209:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 7 pid: 24209 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.807126:0:24209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 7 pid: 24209 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.807139:0:24209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836400, rc 0) 00000100:00100000:2.0:1789048979.807197:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab02f1da-990a-440f-8505-d0174933fc99+7:2393:x1875953097814144:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 930us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048979.807222:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:3.0:1789048979.812859:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.817870:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097814400 00000100:00100000:0.0:1789048979.817886:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097814400 00000100:00100000:0.0:1789048979.817971:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:0.0:1789048979.817981:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+47:18870:x1875953097814400:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789048979.818105:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2b610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+47:18870:x1875953097814400:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 124us (5255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.818113:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1789048979.830099:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.830509:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097814528 00000100:00100000:3.0:1789048979.830528:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097814528 00000100:00100000:3.0:1789048979.830597:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:3.0:1789048979.830607:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+47:18870:x1875953097814528:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789048979.835904:0:22684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901920 is committed 00000004:00080000:3.0:1789048979.835922:0:22684:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789048979.835988:0:22684:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1789048979.836400:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.836414:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.836422:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.836429:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:1.0:1789048979.836433:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.836455:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.836482:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:1.0:1789048979.836485:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789048979.836491:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.836497:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08777ed8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048979.836721:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789048979.836738:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b07958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111554560:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789048979.836820:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048979.836870:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111554560 00000100:00100000:2.0:1789048979.836877:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111554560 00000100:00100000:2.0:1789048979.836927:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789048979.836935:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111554560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789048979.837057:0:24211:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789048979.837061:0:24211:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789048979.837063:0:24211:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789048979.837065:0:24211:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789048980326000000 -> 1789048980326000000 00002000:00010000:2.0:1789048979.837068:0:24211:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789048979.837103:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3623:x1875953111554560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (282us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789048979.837110:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789048979.837132:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789048979.837161:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff959b07958a80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1789048979.837166:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b07958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111554560:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789048979.837750:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837760:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837766:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837782:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.837786:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837792:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837805:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff959c11777800) 00010000:00010000:0.0:1789048979.837809:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.837813:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837819:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837400/0x133f221c08777e84 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837839:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837844:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837851:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837855:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.837858:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837863:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837884:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:0.0:1789048979.837887:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.837890:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837895:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837600/0x133f221c08777e8b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837906:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837913:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837919:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837923:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.837926:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837931:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837939:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff959c11777900) 00010000:00010000:0.0:1789048979.837941:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.837943:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837948:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836c00/0x133f221c08777f33 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837974:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837979:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837984:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837990:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836a00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.837993:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.837998:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838006:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.838008:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.838010:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838015:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836a00/0x133f221c08777fb8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838024:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838029:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838035:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838047:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c07060000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.838049:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838055:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838063:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.838065:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.838068:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838074:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060000/0x133f221c08777fdb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838086:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838092:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838097:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838102:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02837c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.838104:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838110:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838129:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.838131:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.838134:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838140:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02837c00/0x133f221c08778021 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838152:0:3606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838159:0:3606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838165:0:3606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838171:0:3606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef38000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.838174:0:3606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838180:0:3606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838188:0:3606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:0.0:1789048979.838191:0:3606:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789048979.838194:0:3606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.838213:0:3606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780a6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048979.839997:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+14:18870:x1875953097814528:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 9381us (9899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048979.840010:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:2.0:1789048979.848140:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.848237:0:25242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097814656 00000100:00100000:1.0:1789048979.848246:0:25242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097814656 00000100:00100000:1.0:1789048979.848304:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789048979.848315:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b07959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab02f1da-990a-440f-8505-d0174933fc99+7:2394:x1875953097814656:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789048979.848459:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b07959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab02f1da-990a-440f-8505-d0174933fc99+7:2394:x1875953097814656:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.848467:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:2.0:1789048979.851939:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.852042:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097814912 00000100:00100000:0.0:1789048979.852051:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097814912 00000100:00100000:0.0:1789048979.852111:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048979.852121:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+14:18870:x1875953097814912:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789048979.852173:0:22705:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048979.852199:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780bb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e6b expref: 14 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.852221:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:0.0:1789048979.852226:0:22705:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789048979.852254:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780c9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.852267:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780c9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.852276:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780c9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789048979.852450:0:22705:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000d255fe49 reply state 00000000fce8494a transno 12884901921 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780c9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.852463:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38000/0x133f221c087780c9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.852480:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:0.0:1789048979.852483:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789048979.852485:0:22705:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789048979.852592:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+15:18870:x1875953097814912:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 472us (661us total) trans 12884901921 rc 0/0 00000100:00100000:0.0:1789048979.852608:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:3.0:1789048979.864774:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048979.864935:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815040 00000100:00100000:2.0:1789048979.864945:0:24211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815040 00000100:00100000:2.0:1789048979.865005:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048979.865014:0:24211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b0747f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+7:18870:x1875953097815040:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789048979.865061:0:24211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789048979.865081:0:24211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e79 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.865114:0:24211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 8 pid: 24209 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.865124:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048979.865129:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789048979.865133:0:24211:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 8 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.865166:0:24211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 8 pid: 24209 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.865186:0:24211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 8 pid: 24209 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048979.865200:0:24211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24211:1875953111554688:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789048979.869933:0:24211:0:(client.c:2716:ptlrpc_set_wait()) set ffff959b01a75240 going to sleep for 11 seconds 00000100:00100000:2.0:1789048979.882089:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.882377:0:22691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815168 00000100:00100000:1.0:1789048979.882387:0:22691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815168 00010000:00010000:1.0:1789048979.882430:0:22691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 9 pid: 24209 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.882484:0:22691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:1.0:1789048979.882494:0:22691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+9:2393:x1875953097815168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789048979.882509:0:22691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789048979.882540:0:22691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 9 pid: 24209 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.882575:0:22691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 9 pid: 24209 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.882602:0:22691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048979.882607:0:22691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048979.882613:0:22691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 9 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.882623:0:22691:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 9 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.882661:0:22691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 9 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.882675:0:22691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22691:1875953111554816:192.168.202.16@tcp:105: 00000100:00100000:1.0:1789048979.883013:0:22691:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027180 going to sleep for 11 seconds 00010000:00010000:3.0:1789048979.885115:0:24211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012be26eb/0x133f221c087780c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e72 expref: 9 pid: 24209 timeout: 834 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048979.885139:0:24211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24211:1875953111554688:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789048979.885166:0:24211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 8 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.885180:0:24211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c07060000, rc 0) 00000100:00100000:3.0:1789048979.885245:0:24211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b0747f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ab02f1da-990a-440f-8505-d0174933fc99+8:18870:x1875953097815040:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 20231us (20479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048979.885254:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:2.0:1789048979.898758:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.898992:0:22691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22691:1875953111554816:192.168.202.16@tcp:105: 00010000:00010000:1.0:1789048979.899019:0:22691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789048979.899081:0:22691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab02f1da-990a-440f-8505-d0174933fc99+7:2393:x1875953097815168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 16587us (17001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.899091:0:22691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:3.0:1789048979.899215:0:25242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815296 00000100:00100000:3.0:1789048979.899223:0:25242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815296 00000100:00100000:3.0:1789048979.899273:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1789048979.899284:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab02f1da-990a-440f-8505-d0174933fc99+7:2393:x1875953097815296:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789048979.899492:0:25242:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789048979.899496:0:25242:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789048979612000000 00002000:00010000:3.0:1789048979.899498:0:25242:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789048976927329494 00002000:00010000:3.0:1789048979.899501:0:25242:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789048980326000000 -> 1789048979612000000 00002000:00010000:3.0:1789048979.899503:0:25242:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789048979.899727:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ab02f1da-990a-440f-8505-d0174933fc99+8:2393:x1875953097815296:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 444us (977us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789048979.899734:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:2.0:1789048979.904012:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.904110:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815424 00000100:00100000:1.0:1789048979.904122:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815424 00000100:00100000:1.0:1789048979.904184:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:1.0:1789048979.904209:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab02f1da-990a-440f-8505-d0174933fc99+8:2393:x1875953097815424:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789048979.904258:0:24210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.904278:0:24210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 8 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.904287:0:24210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789048979.904293:0:24210:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789048979.904297:0:24210:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.904379:0:24210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 8 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.904401:0:24210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 8 pid: 24211 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.904417:0:24210:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24210:1875953111554944:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048979.904507:0:24210:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027180 going to sleep for 11 seconds 00000100:00100000:2.0:1789048979.910113:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048979.910204:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815552 00000100:00100000:3.0:1789048979.910214:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815552 00010000:00010000:3.0:1789048979.910253:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 9 pid: 24211 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048979.910299:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789048979.910318:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:2393:x1875953097815552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789048979.910403:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789048979.910427:0:22689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 9 pid: 24211 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.910447:0:22689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 9 pid: 24211 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.910480:0:22689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048979.910485:0:22689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789048979.910492:0:22689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.910510:0:22689:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.910927:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789048979.910988:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:2393:x1875953097815552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 670us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048979.910996:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00010000:00010000:1.0:1789048979.911767:0:24210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bfc0fd1/0x133f221c087780d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e79 expref: 8 pid: 24211 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.911787:0:24210:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24210:1875953111554944:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789048979.911827:0:24210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911851:0:24210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911859:0:24210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911883:0:24210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911892:0:24210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911900:0:24210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911907:0:24210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364600 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048979.911912:0:24210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911920:0:24210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911937:0:24210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.911957:0:24210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005822f51/0x133f221c087780d7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.912030:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab02f1da-990a-440f-8505-d0174933fc99+7:2393:x1875953097815424:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 7823us (8029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.912879:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:2.0:1789048979.919158:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.919255:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815808 00000100:00100000:0.0:1789048979.919265:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815808 00000100:00100000:0.0:1789048979.919361:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789048979.919373:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+15:18870:x1875953097815808:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789048979.919450:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.919480:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.919491:0:22704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.919534:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.919554:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 15 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048979.919568:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111555072:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789048979.919650:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c05d16f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789048979.923372:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c064bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111555072:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048979.923406:0:22704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048979.925128:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.925466:0:22690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097815936 00000100:00100000:0.0:1789048979.925492:0:22690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097815936 00010000:00010000:0.0:1789048979.925535:0:22690:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048979.925578:0:22690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:0.0:1789048979.925587:0:22690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab02f1da-990a-440f-8505-d0174933fc99+16:2393:x1875953097815936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789048979.925602:0:22690:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789048979.925609:0:22690:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925626:0:22690:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925653:0:22690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c07060c00/0x133f221c08777fb1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e17 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925671:0:22690:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.925678:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 15 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925813:0:22690:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925822:0:22690:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925830:0:22690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.925873:0:22690:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789048979.925929:0:22690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab02f1da-990a-440f-8505-d0174933fc99+15:2393:x1875953097815936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 342us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.925937:0:22690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00010000:00010000:1.0:1789048979.925996:0:22704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.926005:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.926196:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.926208:0:22704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.926216:0:22704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.926246:0:22704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 15 pid: 22704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.926261:0:22704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 15 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789048979.926274:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111555200:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789048979.926379:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c2b027600 going to sleep for 11 seconds 00000100:00100000:3.0:1789048979.933121:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.933429:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111555200:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789048979.933459:0:22704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048979.933769:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789048979.933789:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111555328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789048979.933849:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048979.933976:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111555328 00000100:00100000:1.0:1789048979.933983:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111555328 00000100:00100000:1.0:1789048979.934056:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048979.934068:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111555328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789048979.934099:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789048979.934146:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111555328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.934154:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789048979.934196:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111555328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789048979.934532:0:22689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097816064 00000100:00100000:2.0:1789048979.934538:0:22689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097816064 00010000:00010000:2.0:1789048979.934565:0:22689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048979.934592:0:22689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789048979.934598:0:22689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c2a4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab02f1da-990a-440f-8505-d0174933fc99+16:2394:x1875953097816064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789048979.934607:0:22689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789048979.934614:0:22689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.934633:0:22689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.934655:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08365e00/0x133f221c087780ad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0xd796648991b29e64 expref: 16 pid: 22704 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.934670:0:22689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:2.0:1789048979.934675:0:22689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.934684:0:22689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048979.934838:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111555456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789048979.934872:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048979.934903:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111555456 00000100:00100000:3.0:1789048979.934907:0:24213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111555456 00000100:00100000:3.0:1789048979.934935:0:24213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048979.934940:0:24213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111555456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789048979.934950:0:24213:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789048979.934982:0:24213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b08846680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875953111555456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048979.934988:0:24213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789048979.935018:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111555456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789048979.935203:0:22689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048979.935236:0:22689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789048979.935279:0:22689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c2a4f1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab02f1da-990a-440f-8505-d0174933fc99+15:2394:x1875953097816064:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 680us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048979.935478:0:22689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00080000:0.0:1789048979.935713:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789048979.936790:0:22704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.936814:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789048979.936935:0:22704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000001:00080000:3.0:1789048979.937082:0:22704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000001:00080000:3.0:1789048979.937121:0:22704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901924 00000100:00100000:3.0:1789048979.937200:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22704:1875953111555584:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789048979.937255:0:22704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048979.937292:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18cef300 going to sleep for 11 seconds 00000100:00100000:1.0:1789048979.937589:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111555584 00000100:00100000:1.0:1789048979.937597:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111555584 00000100:00100000:1.0:1789048979.937643:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789048979.937652:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22704:x1875953111555584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789048979.937748:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22704:x1875953111555584:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048979.937756:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789048979.938268:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b08847800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22704:1875953111555584:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789048979.939671:0:22704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00000100:00100000:3.0:1789048979.939902:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20222a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22704:1875953111555712:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789048979.939954:0:22704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048979.940056:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18cef540 going to sleep for 11 seconds 00000100:00100000:1.0:1789048979.943000:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111555712 00000100:00100000:1.0:1789048979.943014:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111555712 00000100:00100000:1.0:1789048979.943088:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789048979.943100:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22704:x1875953111555712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789048979.943831:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22704:x1875953111555712:12345-0@lo:1000:mdt00_000.0 Request processed in 732us (3874us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1789048979.943842:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789048979.945907:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20222a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22704:1875953111555712:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789048979.945965:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.945977:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.945985:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.945992:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b08364600 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048979.945997:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946005:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946020:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:3.0:1789048979.946023:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789048979.946044:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946051:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b08364600/0x133f221c087780e5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946086:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946093:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946099:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946104:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c02836e00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:3.0:1789048979.946107:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946113:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946121:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:3.0:1789048979.946124:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789048979.946131:0:22704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946143:0:22704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946153:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048979.946239:0:22704:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39e00/0x133f221c08778044 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e48 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789048979.946254:0:22704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111555840:192.168.202.16@tcp:105: 00000100:00100000:3.0:1789048979.946371:0:22704:0:(client.c:2716:ptlrpc_set_wait()) set ffff959c18cef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789048979.956020:0:22704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c20220e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22704:1875953111555840:192.168.202.16@tcp:105: 00010000:00010000:0.0:1789048979.956055:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956066:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836e00/0x133f221c0877803d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956101:0:22704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956115:0:22704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956125:0:22704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956136:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956156:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956162:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956167:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.956171:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956179:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956189:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.956192:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789048979.956195:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956200:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39800/0x133f221c087780ec lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956211:0:22704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956217:0:22704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956222:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956227:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:0.0:1789048979.956235:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956242:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956250:0:22704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.956252:0:22704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048979.956254:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.956260:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780de lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789048979.956493:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+18:18870:x1875953097815808:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 37121us (37343us total) trans 12884901926 rc 0/0 00000100:00100000:0.0:1789048979.956504:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000020:00080000:0.0:1789048979.956511:0:22704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789048979.957323:0:22739:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789048979.957329:0:22739:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789048979.957410:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789048979.957417:0:22739:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789048979.963958:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.964070:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097816192 00000100:00100000:0.0:1789048979.964079:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097816192 00000100:00100000:0.0:1789048979.964136:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1789048979.964145:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+18:18868:x1875953097816192:12345-192.168.202.16@tcp:49:bash.0 00000100:00100000:0.0:1789048979.964279:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+18:18868:x1875953097816192:12345-192.168.202.16@tcp:49:bash.0 Request processed in 134us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.964287:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789048979.965926:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.966318:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097816448 00000100:00100000:0.0:1789048979.966328:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097816448 00000100:00100000:0.0:1789048979.966416:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789048979.966426:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+18:18870:x1875953097816448:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789048979.966773:0:22708:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789048979.966827:0:22708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00010000:00010000:0.0:1789048979.966871:0:22708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.966890:0:22708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.966905:0:22708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.966914:0:22708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.966921:0:22708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.966928:0:22708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.966941:0:22708:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789048979.967044:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+20:18870:x1875953097816448:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 610us (1114us total) trans 12884901928 rc 0/0 00000100:00100000:0.0:1789048979.967053:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000020:00080000:0.0:1789048979.967058:0:22708:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789048979.968680:0:22693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789048979.968706:0:22693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.968718:0:22693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959c3ef39c00 already unused, calling callback (ffffffffc0c858f0) 00010000:00010000:1.0:1789048979.968722:0:22693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.968732:0:22693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.968749:0:22693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff959c3ef46700) 00010000:00010000:1.0:1789048979.968752:0:22693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789048979.968757:0:22693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.968762:0:22693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c087780f3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22708 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789048979.968779:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048979.968781:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789048979.968783:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789048979.981408:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.983153:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097816576 00000100:00100000:0.0:1789048979.983167:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097816576 00000100:00100000:0.0:1789048979.983238:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789048979.983249:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab02f1da-990a-440f-8505-d0174933fc99+7:18868:x1875953097816576:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048979.983267:0:24209:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048979.983312:0:24209:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4d002ad/0x133f221c087780fa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e80 expref: -99 pid: 24209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789048979.983382:0:24209:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x18d3fa91738c5f00, atime: 0x18d3fa90d3878cd6, ctime: 0x18d3fa91738c5f00, blocks: 0x0 00010000:00010000:0.0:1789048979.983407:0:24209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=734s v=(0 0) 00010000:00010000:0.0:1789048979.983412:0:24209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789048979.983422:0:24209:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4d002ad/0x133f221c087780fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e80 expref: 8 pid: 24209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.983440:0:24209:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e4d002ad/0x133f221c087780fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e80 expref: 8 pid: 24209 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.983452:0:24209:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39800, rc 0) 00000100:00100000:0.0:1789048979.983542:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab02f1da-990a-440f-8505-d0174933fc99+8:18868:x1875953097816576:12345-192.168.202.16@tcp:101:bash.0 Request processed in 294us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.983550:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:3.0:1789048979.992260:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048979.992625:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097816704 00000100:00100000:0.0:1789048979.992636:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097816704 00000100:00100000:0.0:1789048979.992707:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789048979.992717:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+20:18868:x1875953097816704:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:0.0:1789048979.992744:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789048979.992769:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08778101 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e87 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.992824:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778108 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.992859:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778108 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.992872:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778108 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.992988:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef38600/0x133f221c08778101 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e87 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.993012:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c3ef39c00/0x133f221c08778108 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e87 expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789048979.993021:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:0.0:1789048979.993025:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789048979.993028:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c3ef39c00, rc 0) 00000100:00100000:0.0:1789048979.993099:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+21:18868:x1875953097816704:12345-192.168.202.16@tcp:101:bash.0 Request processed in 383us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048979.993107:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 71 00000100:00100000:0.0:1789048979.997973:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048979.998062:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097816960 00000100:00100000:1.0:1789048979.998072:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097816960 00000100:00100000:1.0:1789048979.998136:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789048979.998147:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+21:18868:x1875953097816960:12345-192.168.202.16@tcp:35:bash.0 00000001:00080000:1.0:1789048979.998413:0:22708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901929 00000001:00080000:1.0:1789048979.998512:0:22708:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901930 00000100:00100000:1.0:1789048979.998617:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+24:18868:x1875953097816960:12345-192.168.202.16@tcp:35:bash.0 Request processed in 471us (654us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1789048979.998634:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000020:00080000:1.0:1789048979.998639:0:22708:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789048980.119446:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789048980.119617:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097817216 00000100:00100000:3.0:1789048980.119628:0:22706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097817216 00000100:00100000:3.0:1789048980.119704:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:3.0:1789048980.119713:0:22706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+24:18880:x1875953097817216:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789048980.119737:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789048980.119756:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c0877810f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd796648991b29e8e expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789048980.119875:0:22706:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789048980.119986:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c0877810f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e8e expref: 26 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048980.120002:0:22706:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff959c11777e00) 00010000:00010000:3.0:1789048980.120005:0:22706:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789048980.120010:0:22706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959c02836800/0x133f221c0877810f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0xd796648991b29e8e expref: 26 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789048980.120026:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff959c02836800, rc 0) 00000100:00100000:3.0:1789048980.120104:0:22706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab02f1da-990a-440f-8505-d0174933fc99+25:18880:x1875953097817216:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 392us (668us total) trans 12884901932 rc 301/301 00000100:00100000:3.0:1789048980.120113:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 72 00000100:00100000:0.0:1789048980.123168:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789048980.123274:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097817344 00000100:00100000:2.0:1789048980.123284:0:22705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097817344 00000100:00100000:2.0:1789048980.123384:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 73 00000100:00100000:2.0:1789048980.123394:0:22705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+25:18880:x1875953097817344:12345-192.168.202.16@tcp:34:lfs.0 00010000:00010000:2.0:1789048980.123480:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123498:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123510:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123775:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123784:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123791:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123873:0:22705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123882:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123889:0:22705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789048980.123954:0:22705:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123967:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123974:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123983:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.123989:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1400 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048980.123993:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124001:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124014:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff959c11777700) 00010000:00010000:2.0:1789048980.124017:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048980.124021:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124027:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1400/0x133f221c0877811d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124040:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124046:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124058:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124064:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1800 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048980.124067:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124073:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124082:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff959c038ed700) 00010000:00010000:2.0:1789048980.124084:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048980.124088:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124094:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1800/0x133f221c08778124 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124110:0:22705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124116:0:22705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124122:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124127:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff959b07ba1000 already unused, calling callback (ffffffffc189a4f0) 00010000:00010000:2.0:1789048980.124130:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124146:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124154:0:22705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff959c11777000) 00010000:00010000:2.0:1789048980.124156:0:22705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789048980.124159:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789048980.124165:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff959b07ba1000/0x133f221c0877812b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22705 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789048980.124312:0:22705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab02f1da-990a-440f-8505-d0174933fc99+25:18880:x1875953097817344:12345-192.168.202.16@tcp:34:lfs.0 Request processed in 918us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048980.124321:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 73 00010000:00010000:0.0:1789048980.128125:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789048980.135927:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048980.136063:0:22708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097817600 00000100:00100000:1.0:1789048980.136075:0:22708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097817600 00000100:00100000:1.0:1789048980.136152:0:22708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789048980.136165:0:22708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+25:18880:x1875953097817600:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789048980.136866:0:22708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab02f1da-990a-440f-8505-d0174933fc99+26:18880:x1875953097817600:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 702us (953us total) trans 12884901933 rc 0/0 00000100:00100000:1.0:1789048980.136876:0:22708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789048980.542830:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048980.542877:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048980.542912:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048980.542950:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048980.542978:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097817984 00000100:00100000:1.0:1789048980.542989:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097817984 00000100:00100000:1.0:1789048980.543045:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097818496 00000100:00100000:1.0:1789048980.543048:0:24210:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097818496 00000100:00100000:1.0:1789048980.543071:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789048980.543081:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab02f1da-990a-440f-8505-d0174933fc99+5:2391:x1875953097817984:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789048980.543153:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab02f1da-990a-440f-8505-d0174933fc99+5:2391:x1875953097817984:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048980.543162:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789048980.543179:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:1.0:1789048980.543186:0:24210:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2391:x1875953097818496:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048980.543321:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097817728 00000100:00100000:0.0:1789048980.543326:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097817728 00000100:00100000:0.0:1789048980.543402:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:0.0:1789048980.543410:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2391:x1875953097817728:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048980.543439:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e7caf8bb-664b-472f-b0ee-e5fe282977ce+13:2391:x1875953097817728:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 31us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048980.543455:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:0.0:1789048980.543528:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048980.543576:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048980.543669:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048980.543685:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097818368 00000100:00100000:0.0:1789048980.543688:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097818368 00000100:00100000:0.0:1789048980.543706:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789048980.543711:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c31178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2391:x1875953097818368:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048980.543738:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c31178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2391:x1875953097818368:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048980.543744:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:0.0:1789048980.543771:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097818240 00000100:00100000:0.0:1789048980.543775:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097818240 00000100:00100000:0.0:1789048980.543796:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097817856 00000100:00100000:0.0:1789048980.543799:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097817856 00000100:00100000:0.0:1789048980.543812:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097818112 00000100:00100000:0.0:1789048980.543815:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097818112 00000100:00100000:0.0:1789048980.543829:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789048980.543835:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2391:x1875953097818240:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048980.543883:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2391:x1875953097818240:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048980.543890:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:0.0:1789048980.543902:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048980.543909:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+5:2391:x1875953097817856:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048980.543932:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab02f1da-990a-440f-8505-d0174933fc99+5:2391:x1875953097817856:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048980.543947:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:0.0:1789048980.543960:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789048980.543966:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2391:x1875953097818112:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789048980.543994:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c064b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33100e65-e304-4913-82a7-bb107e2e9bbb+6:2391:x1875953097818112:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048980.544000:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00080000:0.0:1789048980.544071:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789048980.544075:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789048980.544078:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789048980.544080:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048980.544732:0:24210:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33100e65-e304-4913-82a7-bb107e2e9bbb+5:2391:x1875953097818496:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 1546us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048980.544740:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:3.0:1789048980.957646:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111555968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048980.957735:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048980.957996:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111555968 00000100:00100000:2.0:1789048980.958015:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111555968 00000100:00100000:2.0:1789048980.958089:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789048980.958099:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111555968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789048980.958139:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789048980.958205:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875953111555968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789048980.958212:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789048980.958522:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3621:1875953111555968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789048980.959643:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789048980.959663:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111556096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789048980.959731:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048980.960030:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556096 00000100:00100000:1.0:1789048980.960039:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556096 00000100:00100000:1.0:1789048980.960089:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789048980.960098:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c20222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111556096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789048980.960126:0:22709:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1789048980.960169:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c20222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875953111556096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048980.960176:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789048980.960480:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3623:1875953111556096:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789048981.086406:0:23457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789048981.150945:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789048981.981710:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789048981.981733:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111556224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789048981.981802:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048981.981842:0:24212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556224 00000100:00100000:3.0:1789048981.981851:0:24212:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556224 00000100:00100000:3.0:1789048981.981930:0:24212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789048981.981941:0:24212:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111556224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789048981.981970:0:24212:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789048981.982027:0:24212:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111556224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00080000:1.0:1789048981.982028:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048981.982037:0:24212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789048981.982044:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959c3117bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111556352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789048981.982076:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048981.982147:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b080d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111556224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789048981.982201:0:25159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556352 00000100:00100000:3.0:1789048981.982206:0:25159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556352 00000100:00080000:1.0:1789048981.982281:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048981.982283:0:25159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789048981.982293:0:25159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111556352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789048981.982304:0:25159:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789048981.982364:0:25159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875953111556352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048981.982384:0:25159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789048981.982388:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959c3117bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3620:1875953111556352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789048981.982554:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111556480:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.982598:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048981.982635:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111556992:0@lo:400:kworker.0 00000100:00100000:2.0:1789048981.982639:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111556736:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.982664:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048981.982683:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048981.982689:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111557504:0@lo:400:kworker.0 00000100:00100000:2.0:1789048981.982711:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111557248:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.982723:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789048981.982744:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048981.982749:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789048981.982758:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111556864:0@lo:400:kworker.0 00000100:00100000:2.0:1789048981.982769:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111557760:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.982788:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789048981.982968:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111557504 00000100:00100000:3.0:1789048981.982974:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111557504 00000100:00100000:3.0:1789048981.983008:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111557248 00000100:00100000:3.0:1789048981.983012:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111557248 00000100:00100000:3.0:1789048981.983025:0:25241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556864 00000100:00100000:3.0:1789048981.983028:0:25241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556864 00000100:00100000:3.0:1789048981.983043:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048981.983051:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111557504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048981.983088:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875953111557504:12345-0@lo:400:kworker.0 Request processed in 39us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048981.983095:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789048981.983106:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048981.983111:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111557248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048981.983135:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875953111557248:12345-0@lo:400:kworker.0 Request processed in 24us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048981.983141:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789048981.983151:0:25241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789048981.983157:0:25241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111556864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048981.983179:0:25241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875953111556864:12345-0@lo:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048981.983185:0:25241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789048981.983200:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789048981.983307:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875953111556864:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983314:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111557376:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983362:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789048981.983398:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06a85180 x1875953111557504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789048981.983410:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3621:1875953111557504:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983455:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556480 00000100:00100000:0.0:1789048981.983460:0:22696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556480 00000100:00100000:0.0:1789048981.983489:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789048981.983495:0:22696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3621:x1875953111556480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983528:0:22696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3c48a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2d3f2942-6380-4c90-a339-b9cf9971a742+24:3621:x1875953111556480:12345-0@lo:400:kworker.0 Request processed in 34us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048981.983534:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789048981.983561:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556736 00000100:00100000:0.0:1789048981.983564:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556736 00000100:00100000:0.0:1789048981.983590:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789048981.983599:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111556736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983633:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875953111556736:12345-0@lo:400:kworker.0 Request processed in 37us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048981.983641:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789048981.983664:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111557376 00000100:00100000:0.0:1789048981.983667:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111557376 00000100:00100000:0.0:1789048981.983690:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789048981.983697:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111557376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789048981.983716:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556992 00000100:00100000:1.0:1789048981.983723:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556992 00000100:00100000:0.0:1789048981.983728:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3958c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875953111557376:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048981.983735:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789048981.983761:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789048981.983767:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111556608:0@lo:400:kworker.0 00000100:00100000:1.0:1789048981.983774:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111556992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983802:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048981.983825:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959c3117bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875953111556992:12345-0@lo:400:kworker.0 Request processed in 54us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048981.983831:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111557120:0@lo:400:kworker.0 00000100:00100000:1.0:1789048981.983833:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789048981.983858:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111556608 00000100:00100000:0.0:1789048981.983860:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789048981.983863:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111556608 00000100:00100000:0.0:1789048981.983881:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff959b06a87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111557632:0@lo:400:kworker.0 00000100:00100000:1.0:1789048981.983899:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789048981.983911:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b05d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111556608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.983913:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048981.983945:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111557632 00000100:00100000:0.0:1789048981.983950:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111557632 00000100:00100000:1.0:1789048981.983961:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b05d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875953111556608:12345-0@lo:400:kworker.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048981.983968:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789048981.983979:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789048981.983987:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111557632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.984017:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875953111557632:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048981.984023:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789048981.984053:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3621:1875953111557376:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.984064:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3621:1875953111556992:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.984074:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2d3f2942-6380-4c90-a339-b9cf9971a742:3621:1875953111556480:0@lo:400:kworker.0 00000100:00100000:3.0:1789048981.984236:0:25242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111557120 00000100:00100000:3.0:1789048981.984240:0:25242:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111557120 00000100:00100000:3.0:1789048981.984272:0:25242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789048981.984278:0:25242:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111557120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789048981.984314:0:25242:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3622:x1875953111557120:12345-0@lo:400:kworker.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789048981.984321:0:25242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789048981.984366:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789048981.984371:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789048981.985120:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3622:1875953111556608:0@lo:400:kworker.0 00000100:00100000:1.0:1789048981.985136:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3622:1875953111557120:0@lo:400:kworker.0 00000100:00100000:1.0:1789048981.985146:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3622:1875953111557632:0@lo:400:kworker.0 00000100:00100000:2.0:1789048981.987617:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789048981.987665:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953111557760 00000100:00100000:0.0:1789048981.987675:0:22704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953111557760 00000100:00100000:2.0:1789048981.987701:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3623:1875953111556736:0@lo:400:kworker.0 00000100:00100000:2.0:1789048981.987716:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875953111557248:0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.987758:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789048981.987768:0:22704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b06a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111557760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789048981.987844:0:22704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b06a87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875953111557760:12345-0@lo:400:kworker.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789048981.987851:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789048981.987902:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789048981.989362:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff959b06a85f80 x1875953111557760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789048997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789048981.989379:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff959b06a85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3623:1875953111557760:0@lo:400:kworker.0 00010000:00010000:2.0:1789048982.191650:0:22693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789048982.246651:0:25789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1789048982.597636:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789048982.597683:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789048982.597773:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097818752 00000100:00100000:1.0:1789048982.597782:0:24209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097818752 00000100:00100000:3.0:1789048982.597874:0:24214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875953097818624 00000100:00100000:1.0:1789048982.597877:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1789048982.597879:0:24214:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875953097818624 00000100:00100000:1.0:1789048982.597888:0:24209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:2392:x1875953097818752:12345-192.168.202.16@tcp:16:kworker.0 00002000:00100000:3.0:1789048982.597912:0:24214:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff959b080a0a80 x1875953097818624/t0(0) o4->ab02f1da-990a-440f-8505-d0174933fc99@192.168.202.16@tcp:238/0 lens 504/0 e 0 to 0 dl 1789048993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789048982.597921:0:24214:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b080a0a80 with x1875953097818624 ext(0->8) 00002000:00010000:3.0:1789048982.597926:0:24214:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff959b080a0a80 00000100:00100000:3.0:1789048982.597941:0:24214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789048982.597947:0:24214:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:2392:x1875953097818624:12345-192.168.202.16@tcp:4:bash.0 00000100:00100000:1.0:1789048982.598013:0:24209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab02f1da-990a-440f-8505-d0174933fc99+9:2392:x1875953097818752:12345-192.168.202.16@tcp:16:kworker.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789048982.598020:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00080000:2.0:1789048982.598095:0:22700:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789048982.604664:0:24214:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff959b080a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ab02f1da-990a-440f-8505-d0174933fc99+10:2392:x1875953097818624:12345-192.168.202.16@tcp:4:bash.0 Request processed in 6706us (7026us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1789048982.604677:0:24214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00002000:00100000:3.0:1789048982.604691:0:24214:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff959b080a0a80 x1875953097818624/t12884901895(0) o4->ab02f1da-990a-440f-8505-d0174933fc99@192.168.202.16@tcp:238/0 lens 504/448 e 0 to 0 dl 1789048993 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1789048982.604699:0:24214:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff959b080a0a80 with x1875953097818624 ext(0->8) 00002000:00010000:3.0:1789048982.604706:0:24214:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff959b080a0a80 00010000:00010000:0.0:1789048983.197733:0:22692:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789048984.221945:0:25734:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 15162 lines, 15162 kept, 0 dropped, 0 bad.