00000100:00100000:1.0F:1787383524.923027:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383524.923089:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383524.923122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383524.923155:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032384 00000100:00100000:1.0:1787383524.923164:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032384 00000100:00100000:1.0:1787383524.923227:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:1.0:1787383524.923237:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966032384:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0F:1787383524.923371:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032128 00000100:00100000:0.0:1787383524.923382:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032128 00000100:00100000:0.0:1787383524.923419:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:0.0:1787383524.923426:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966032128:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.923480:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966032128:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 54us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.923487:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00080000:0.0:1787383524.923536:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383524.923542:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383524.923567:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383524.923688:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383524.923709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383524.923723:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032640 00000100:00100000:0.0:1787383524.923727:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032640 00000100:00100000:0.0:1787383524.923752:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032000 00000100:00100000:0.0:1787383524.923755:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032000 00000100:00100000:0.0:1787383524.923795:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1787383524.923803:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966032640:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.923835:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966032640:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.923842:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1787383524.923853:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1787383524.923860:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+22:2401:x1874206966032000:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.923886:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+22:2401:x1874206966032000:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.923892:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00080000:0.0:1787383524.923907:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383524.923909:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383524.923942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383524.924666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383524.924805:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383524.924831:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032512 00000100:00100000:0.0:1787383524.924836:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032512 00000100:00100000:0.0:1787383524.924870:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:0.0:1787383524.924877:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2401:x1874206966032512:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.924920:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2401:x1874206966032512:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 42us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.924928:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00080000:0.0:1787383524.924943:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383524.924990:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032896 00000100:00100000:0.0:1787383524.924994:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032896 00000100:00100000:0.0:1787383524.925014:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032256 00000100:00100000:0.0:1787383524.925016:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032256 00000100:00100000:0.0:1787383524.925027:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966032768 00000100:00100000:0.0:1787383524.925029:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966032768 00000100:00100000:0.0:1787383524.925041:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1787383524.925047:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966032896:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.925076:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966032896:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.925083:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1787383524.925093:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383524.925098:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966032256:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.925119:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966032256:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 21us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.925125:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383524.925144:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:0.0:1787383524.925150:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966032768:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383524.925174:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2401:x1874206966032768:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383524.925180:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00080000:0.0:1787383524.925195:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383524.925198:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383524.926593:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2401:x1874206966032384:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 3343us (3455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383524.926659:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:2.0F:1787383524.928385:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966031872 00000100:00100000:2.0:1787383524.928406:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966031872 00000100:00100000:2.0:1787383524.928464:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:2.0:1787383524.928473:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+13:2401:x1874206966031872:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383524.928538:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67005cab-7d30-4f92-84d7-5c04932340db+13:2401:x1874206966031872:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 66us (5520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383524.928546:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 165 00000100:00100000:0.0:1787383525.019021:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383525.019045:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984983040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383525.019110:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383525.019159:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983040 00000100:00100000:0.0:1787383525.019166:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983040 00000100:00100000:0.0:1787383525.019220:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383525.019231:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984983040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383525.019278:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383525.019325:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984983040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383525.019334:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787383525.019363:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383525.019405:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984983040:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383525.019445:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1787383526.046178:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383526.046271:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984983168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383526.046556:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383526.046617:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383526.046626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984983296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383526.046650:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383526.046685:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983168 00000100:00100000:0.0:1787383526.046698:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983168 00000100:00100000:0.0:1787383526.046737:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983296 00000100:00100000:0.0:1787383526.046741:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983296 00000100:00100000:0.0:1787383526.046755:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787383526.046762:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984983168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383526.046817:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787383526.046865:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984983168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383526.046872:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787383526.046888:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383526.046894:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984983296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383526.046909:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383526.046948:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984983296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383526.046955:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383526.046998:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984983296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383526.047011:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984983168:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1787383527.074359:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1787383527.074380:0:17074:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff963618fea900 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1787383527.074385:0:17074:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963635e69400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff963618fea300 00000020:00080000:1.0:1787383527.074389:0:17074:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963635e69900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9635026cf800 00000020:00080000:1.0:1787383527.074413:0:17134:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1787383527.074477:0:17134:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787383527.074553:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383527.074575:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383527.074583:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383527.074588:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383527.074593:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383527.074611:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383527.074629:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:0.0:1787383527.074633:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787383527.074638:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383527.074644:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7600/0xc40acec91532fdae lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383527.075782:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383527.561487:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383527.562987:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033024 00000100:00100000:1.0:1787383527.563000:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033024 00000100:00100000:1.0:1787383527.563080:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:1.0:1787383527.563092:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+13:15582:x1874206966033024:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787383527.563194:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+13:15582:x1874206966033024:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 104us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383527.563202:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00080000:3.0:1787383527.565065:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383527.575188:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383527.577309:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033152 00000100:00100000:3.0:1787383527.577321:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033152 00000100:00100000:3.0:1787383527.577542:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:3.0:1787383527.577553:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:15582:x1874206966033152:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787383527.577671:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:15582:x1874206966033152:12345-192.168.203.2@tcp:60:lhsmtool_posix.0 Request processed in 120us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383527.577679:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00080000:0.0:1787383527.577886:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383527.585496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383527.585605:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033408 00000100:00100000:3.0:1787383527.585615:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033408 00000100:00100000:3.0:1787383527.585726:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1787383527.585737:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+13:15582:x1874206966033408:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787383527.586011:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+14:15582:x1874206966033408:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 275us (521us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787383527.586019:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00010000:00010000:3.0:1787383528.092022:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383528.603545:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984983680:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.603677:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603704:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.603738:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984984704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.603796:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984985216:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603818:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.603840:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787383528.603847:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984983808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603887:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.603904:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984984320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603938:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.603956:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984984832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.603993:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.604025:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983808 00000100:00100000:0.0:1787383528.604031:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983808 00000100:00100000:0.0:1787383528.604066:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984320 00000100:00100000:0.0:1787383528.604069:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984320 00000100:00100000:0.0:1787383528.604083:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383528.604090:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984983808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604140:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984983808:12345-0@lo:400:kworker.0 Request processed in 50us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.604148:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787383528.604163:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383528.604170:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984984320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604196:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984984320:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.604201:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383528.604219:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984192 00000100:00100000:0.0:1787383528.604222:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984192 00000100:00100000:0.0:1787383528.604242:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984704 00000100:00100000:0.0:1787383528.604244:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984704 00000100:00100000:0.0:1787383528.604254:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985216 00000100:00100000:0.0:1787383528.604256:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985216 00000100:00100000:0.0:1787383528.604271:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984832 00000100:00100000:0.0:1787383528.604273:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984832 00000100:00100000:0.0:1787383528.604285:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383528.604290:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984984192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604314:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984984192:12345-0@lo:400:kworker.0 Request processed in 25us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.604320:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787383528.604338:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383528.604343:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984984704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604370:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984984704:12345-0@lo:400:kworker.0 Request processed in 26us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.604375:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787383528.604385:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383528.604391:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984985216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604413:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984985216:12345-0@lo:400:kworker.0 Request processed in 22us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.604417:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383528.604427:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383528.604433:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984984832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604456:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984984832:12345-0@lo:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.604461:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383528.604491:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984983808:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604500:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984984320:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604508:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984984832:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604516:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984984192:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.604523:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984984704:0@lo:400:kworker.0 00010000:00080000:0.0:1787383528.604533:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da09180 x1874206984985216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383528.604543:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984985216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383528.604833:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983680 00000100:00100000:1.0:1787383528.604843:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983680 00000100:00100000:1.0:1787383528.604881:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787383528.604888:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3649:x1874206984983680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383528.604924:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3649:x1874206984983680:12345-0@lo:400:kworker.0 Request processed in 37us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383528.604931:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787383528.604965:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383528.604969:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383528.605566:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984983424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383528.605606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.605610:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984983680:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.605626:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383528.605627:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984983936:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.605631:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984985344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383528.605649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.605653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383528.605675:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983424 00000100:00100000:0.0:1787383528.605679:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983424 00000100:00100000:3.0:1787383528.605703:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984984448:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.605710:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985344 00000100:00100000:0.0:1787383528.605712:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985344 00000100:00100000:3.0:1787383528.605736:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383528.605753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984984960:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.605810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383528.605829:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1787383528.605835:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984983552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383528.605870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383528.605880:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984984064:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.605898:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383528.605914:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984984576:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.605931:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383528.605945:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984985088:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.605962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383528.605990:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983936 00000100:00100000:3.0:1787383528.606004:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983936 00000100:00100000:0.0:1787383528.606015:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383528.606023:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984983424:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383528.606027:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984448 00000100:00100000:3.0:1787383528.606029:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984448 00000100:00100000:3.0:1787383528.606040:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984064 00000100:00100000:3.0:1787383528.606042:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984064 00002000:00000024:0.0:1787383528.606047:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787383528.606052:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984576 00000100:00100000:3.0:1787383528.606053:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984576 00000100:00100000:3.0:1787383528.606062:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383528.606068:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984983936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.606082:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984983424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.606089:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383528.606092:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984983936:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606098:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383528.606100:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984983552 00000100:00100000:0.0:1787383528.606103:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984983552 00000100:00100000:3.0:1787383528.606108:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383528.606112:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984984448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.606114:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787383528.606118:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206984985344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383528.606130:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383528.606135:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984984448:12345-0@lo:400:kworker.0 Request processed in 23us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606149:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787383528.606154:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206984985344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606159:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383528.606160:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383528.606164:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984984064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.606168:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383528.606172:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984983552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383528.606180:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383528.606189:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984984064:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606196:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383528.606196:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206984983552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 24us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606205:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383528.606208:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383528.606210:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984984576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.606245:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984984576:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383528.606247:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984983552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383528.606251:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383528.606256:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984984064:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.606264:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984984576:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.606271:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984984960 00000100:00100000:3.0:1787383528.606273:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984984960 00000100:00100000:0.0:1787383528.606275:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984983424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383528.606282:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984983936:0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.606290:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984984448:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.606293:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985088 00000100:00100000:3.0:1787383528.606295:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985088 00000100:00100000:3.0:1787383528.606307:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383528.606312:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984984960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383528.606322:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984985344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383528.606348:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984984960:12345-0@lo:400:kworker.0 Request processed in 35us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606353:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1787383528.606356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da0aa00 x1874206984984960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383528.606364:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787383528.606367:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984984960:0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.606369:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984985088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383528.606399:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635033bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206984985088:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383528.606404:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787383528.606406:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984985088:0@lo:400:kworker.0 00000100:00080000:1.0:1787383528.606808:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383528.606813:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383528.606815:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383528.606817:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787383529.116468:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383529.691151:0:17128:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787383529.691161:0:17128:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383529.691183:0:17128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787383529.691191:0:17128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787383530.048104:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048178:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048212:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048228:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048279:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048294:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048346:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383530.048377:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033920 00000100:00100000:2.0:1787383530.048385:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033920 00000100:00100000:2.0:1787383530.048435:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034048 00000100:00100000:2.0:1787383530.048438:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034048 00000100:00100000:2.0:1787383530.048452:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034432 00000100:00100000:2.0:1787383530.048454:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034432 00000100:00100000:2.0:1787383530.048466:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034560 00000100:00100000:2.0:1787383530.048469:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034560 00000100:00100000:2.0:1787383530.048483:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1787383530.048491:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2404:x1874206966034048:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383530.048567:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2404:x1874206966034048:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 76us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383530.048574:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:2.0:1787383530.048599:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:2.0:1787383530.048605:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2400:x1874206966033920:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:2.0:1787383530.048624:0:18599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fadd 00000100:00080000:2.0:1787383530.048640:0:18599:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383530.048684:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787383530.049034:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:0.0:1787383530.049044:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2400:x1874206966034432:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:0.0:1787383530.049064:0:18602:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fb1c 00000100:00080000:0.0:1787383530.049070:0:18602:0:(import.c:65:import_set_state_nolock()) ffff96363cd5d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787383530.049098:0:18602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787383530.049173:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+2:2400:x1874206966034432:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 131us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383530.049180:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:0.0:1787383530.049192:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1787383530.049199:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2400:x1874206966034560:12345-192.168.203.2@tcp:9:kworker.0 00000020:00000080:0.0:1787383530.049210:0:18602:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fb23 00000100:00080000:0.0:1787383530.049216:0:18602:0:(import.c:65:import_set_state_nolock()) ffff96363ca46000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787383530.049236:0:18602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787383530.049318:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+2:2400:x1874206966034560:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 119us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383530.049324:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1787383530.049376:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033792 00000100:00100000:0.0:1787383530.049381:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033792 00000100:00100000:0.0:1787383530.049406:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033664 00000100:00100000:0.0:1787383530.049410:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033664 00000100:00100000:0.0:1787383530.049422:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034176 00000100:00100000:0.0:1787383530.049424:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034176 00000100:00100000:0.0:1787383530.049435:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034304 00000100:00100000:0.0:1787383530.049437:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034304 00000100:00100000:0.0:1787383530.049449:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1787383530.049456:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2403:x1874206966033792:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383530.049482:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2403:x1874206966033792:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383530.049489:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1787383530.049501:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:0.0:1787383530.049507:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+14:2403:x1874206966033664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383530.049536:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+14:2403:x1874206966033664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 29us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383530.049559:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:0.0:1787383530.049572:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:0.0:1787383530.049578:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2404:x1874206966034176:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383530.049602:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2404:x1874206966034176:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383530.049609:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:0.0:1787383530.049620:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:0.0:1787383530.049625:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2404:x1874206966034304:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383530.049660:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2404:x1874206966034304:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 35us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383530.049666:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:2.0:1787383530.049967:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eeae0f85-81db-4a53-adaf-9a6519b93273+2:2400:x1874206966033920:12345-192.168.203.2@tcp:9:kworker.0 Request processed in 1361us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383530.049974:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00080000:1.0:1787383530.050095:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383530.050100:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383530.050102:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383530.050104:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383530.050451:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966033536 00000100:00100000:3.0:1787383530.050458:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966033536 00000100:00100000:3.0:1787383530.050497:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 167 00000100:00100000:3.0:1787383530.050504:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:2403:x1874206966033536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383530.050555:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+13:2403:x1874206966033536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383530.050561:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 167 00010000:00010000:3.0:1787383530.050591:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383530.050597:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383530.050605:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383530.139210:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383530.139371:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984985472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383530.139438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383530.139539:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985472 00000100:00100000:1.0:1787383530.139557:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985472 00000100:00100000:1.0:1787383530.139618:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383530.139629:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984985472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383530.139659:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383530.139726:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984985472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383530.139733:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383530.139825:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984985472:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787383530.140404:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383531.163050:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383531.163073:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984985600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383531.163137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383531.163188:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985600 00000100:00100000:0.0:1787383531.163196:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985600 00000100:00100000:0.0:1787383531.163238:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383531.163247:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984985600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383531.163276:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787383531.164202:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383531.164214:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984985728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383531.164264:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383531.164279:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984985600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1030us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383531.164299:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383531.164331:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985728 00000100:00100000:0.0:1787383531.164336:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985728 00000100:00100000:2.0:1787383531.164358:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984985600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787383531.164486:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383531.164995:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383531.165006:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984985728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383531.165031:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383531.165082:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984985728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383531.165089:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787383531.165158:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984985728:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787383531.769210:0:20472:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 03:25:30 (1787383530) 00000040:00080000:2.0:1787383531.931799:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383532.188098:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787383532.702127:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1787383532.702142:0:17074:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1787383532.702185:0:17134:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1787383532.702203:0:17134:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1787383533.212361:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383533.724431:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984985856:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724512:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724577:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984986368:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724602:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724622:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984986880:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724643:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724662:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984987392:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724683:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724706:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787383533.724713:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984986240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724735:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724754:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984986752:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724815:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984987264:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724835:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724864:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984985984:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724888:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724903:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984986496:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724923:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724937:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984987008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.724967:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787383533.724972:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984986112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.724992:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.725009:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984986624:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.725051:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984987136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725071:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383533.725097:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985856 00000100:00100000:1.0:1787383533.725104:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985856 00000100:00100000:1.0:1787383533.725144:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787383533.725154:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3650:x1874206984985856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725202:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3650:x1874206984985856:12345-0@lo:400:kworker.0 Request processed in 49us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725209:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787383533.725238:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986368 00000100:00100000:1.0:1787383533.725241:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986368 00000100:00100000:1.0:1787383533.725259:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986880 00000100:00100000:1.0:1787383533.725262:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986880 00000100:00100000:1.0:1787383533.725274:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987392 00000100:00100000:1.0:1787383533.725276:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987392 00000100:00100000:1.0:1787383533.725297:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987264 00000100:00100000:1.0:1787383533.725299:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987264 00000100:00100000:1.0:1787383533.725310:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987008 00000100:00100000:1.0:1787383533.725312:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987008 00000100:00100000:1.0:1787383533.725324:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987136 00000100:00100000:1.0:1787383533.725326:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987136 00000100:00100000:1.0:1787383533.725340:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787383533.725346:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984986368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725376:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206984986368:12345-0@lo:400:kworker.0 Request processed in 30us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725382:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787383533.725394:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787383533.725401:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725434:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206984986880:12345-0@lo:400:kworker.0 Request processed in 34us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725441:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787383533.725453:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787383533.725459:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984987392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725485:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206984987392:12345-0@lo:400:kworker.0 Request processed in 26us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725490:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787383533.725502:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787383533.725508:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984987264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725548:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206984987264:12345-0@lo:400:kworker.0 Request processed in 40us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725554:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787383533.725565:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787383533.725570:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984987008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725600:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350206aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206984987008:12345-0@lo:400:kworker.0 Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725605:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787383533.725616:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383533.725622:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984987136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725646:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206984987136:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725651:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787383533.725670:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986240 00000100:00100000:1.0:1787383533.725673:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986240 00000100:00100000:1.0:1787383533.725700:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986752 00000100:00100000:1.0:1787383533.725704:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986752 00000100:00100000:1.0:1787383533.725716:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986112 00000100:00100000:1.0:1787383533.725718:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986112 00000100:00100000:1.0:1787383533.725728:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986624 00000100:00100000:1.0:1787383533.725730:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986624 00000100:00100000:1.0:1787383533.725743:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383533.725748:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984986240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725800:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206984986240:12345-0@lo:400:kworker.0 Request processed in 52us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725806:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383533.725817:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383533.725822:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725847:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984986752:12345-0@lo:400:kworker.0 Request processed in 24us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725853:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383533.725862:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383533.725867:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984986112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725892:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984986112:12345-0@lo:400:kworker.0 Request processed in 25us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725897:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383533.725907:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383533.725912:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984986624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.725935:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984986624:12345-0@lo:400:kworker.0 Request processed in 23us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383533.725940:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787383533.725960:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787383533.725970:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787383533.725973:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383533.725975:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383533.726024:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984986112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726036:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984986624:0@lo:400:kworker.0 00010000:00080000:1.0:1787383533.726047:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504419500 x1874206984987136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383533.726057:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984987136:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726067:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206984987008:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726100:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206984986240:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726109:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984986752:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726117:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206984987264:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726125:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984985856:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726133:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206984986368:0@lo:400:kworker.0 00000100:00100000:1.0:1787383533.726142:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206984986880:0@lo:400:kworker.0 00010000:00080000:1.0:1787383533.726152:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350441ad80 x1874206984987392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383533.726160:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206984987392:0@lo:400:kworker.0 00000100:00100000:3.0:1787383533.727127:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984985984 00000100:00100000:3.0:1787383533.727135:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984985984 00000100:00100000:3.0:1787383533.727176:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984986496 00000100:00100000:3.0:1787383533.727180:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984986496 00000100:00100000:3.0:1787383533.727195:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787383533.727201:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984985984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383533.727256:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503fd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984985984:12345-0@lo:400:kworker.0 Request processed in 55us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383533.727263:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787383533.727277:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383533.727283:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984986496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383533.727309:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963502069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984986496:12345-0@lo:400:kworker.0 Request processed in 27us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383533.727314:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787383533.727444:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984985984:0@lo:400:kworker.0 00000100:00100000:3.0:1787383533.727455:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984986496:0@lo:400:kworker.0 00000100:00100000:3.0:1787383533.727762:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383533.727819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383533.727843:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383533.727849:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984987648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383533.727868:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383533.727892:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987520 00000100:00100000:3.0:1787383533.727895:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987520 00000100:00100000:3.0:1787383533.727919:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987648 00000100:00100000:3.0:1787383533.727922:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987648 00000100:00100000:3.0:1787383533.727933:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383533.727938:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984987520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383533.727957:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383533.727988:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984987520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383533.727994:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787383533.728004:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383533.728010:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984987648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787383533.728023:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787383533.728047:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984987648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383533.728053:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383533.728084:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984987648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383533.728096:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383533.728199:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383533.728208:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984987776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383533.728233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383533.728289:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987776 00000100:00100000:3.0:1787383533.728292:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987776 00000100:00100000:3.0:1787383533.728321:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383533.728328:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984987776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383533.728337:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383533.728364:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984987776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383533.728432:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787383533.728553:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984987776:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787383534.236929:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383535.159219:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383535.159269:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383535.159313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383535.159331:0:17088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034688 00000100:00100000:1.0:1787383535.159341:0:17088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034688 00000100:00100000:1.0:1787383535.159407:0:17088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:1.0:1787383535.159463:0:17088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:2402:x1874206966034688:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383535.159507:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383535.159562:0:17088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67005cab-7d30-4f92-84d7-5c04932340db+13:2402:x1874206966034688:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 145us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383535.159571:0:17088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 169 00000100:00100000:1.0:1787383535.164436:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034944 00000100:00100000:1.0:1787383535.164451:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034944 00000100:00100000:1.0:1787383535.164531:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035200 00000100:00100000:1.0:1787383535.164534:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035200 00000100:00100000:1.0:1787383535.164549:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966034816 00000100:00100000:1.0:1787383535.164551:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966034816 00000100:00100000:1.0:1787383535.164583:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:1.0:1787383535.164593:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966034944:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383535.164683:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966034944:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 92us (5412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383535.164690:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 79 00000100:00100000:1.0:1787383535.164708:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:1.0:1787383535.164715:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966035200:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383535.164742:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2402:x1874206966035200:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 28us (5429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383535.164748:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 80 00000100:00100000:1.0:1787383535.164759:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00100000:1.0:1787383535.164790:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+13:2402:x1874206966034816:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383535.164814:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+13:2402:x1874206966034816:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 49us (5308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383535.164820:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 81 00000100:00080000:1.0:1787383535.164836:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787383535.164855:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787383535.165086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383535.165121:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383535.165289:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035328 00000100:00100000:0.0:1787383535.165295:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035328 00000100:00100000:1.0:1787383535.165952:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035072 00000100:00100000:1.0:1787383535.165957:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035072 00000100:00100000:1.0:1787383535.166062:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:1.0:1787383535.166079:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966035072:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383535.166127:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2402:x1874206966035072:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 57us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383535.166134:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00080000:0.0:1787383535.167487:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383535.167495:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383535.168373:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 82 00000100:00100000:2.0:1787383535.168399:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2402:x1874206966035328:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383535.168478:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2402:x1874206966035328:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 82us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383535.168486:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 82 00010000:00010000:3.0:1787383535.259032:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383535.259557:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984987904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383535.259638:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383535.259716:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984987904 00000100:00100000:2.0:1787383535.259725:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984987904 00000100:00100000:2.0:1787383535.259811:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787383535.259822:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984987904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383535.259852:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383535.259900:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984987904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383535.259907:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787383535.260019:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383535.260047:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984987904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787383535.473931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383535.474072:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035584 00000100:00100000:0.0:1787383535.474081:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035584 00000100:00100000:0.0:1787383535.474136:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1787383535.474146:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+13:16343:x1874206966035584:12345-192.168.203.2@tcp:35:umount.0 00000001:00080000:0.0:1787383535.474739:0:17098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787383535.474855:0:17098:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1787383535.475069:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+16:16343:x1874206966035584:12345-192.168.203.2@tcp:35:umount.0 Request processed in 922us (1145us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1787383535.475078:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000020:00080000:0.0:1787383535.475083:0:17098:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787383535.482522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383535.482566:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383535.482677:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383535.483157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383535.483180:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035712 00000100:00100000:1.0:1787383535.483187:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035712 00000100:00100000:1.0:1787383535.483247:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1787383535.483257:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2400:x1874206966035712:12345-192.168.203.2@tcp:9:umount.0 00000020:00000080:1.0:1787383535.483290:0:18600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fae4 00000100:00080000:1.0:1787383535.483299:0:18600:0:(import.c:65:import_set_state_nolock()) ffff963622d80800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383535.483367:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787383535.483537:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+2:2400:x1874206966035712:12345-192.168.203.2@tcp:9:umount.0 Request processed in 281us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383535.483544:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00010000:00010000:1.0:1787383535.483695:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383535.486960:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035968 00000100:00100000:2.0:1787383535.486974:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035968 00000100:00100000:2.0:1787383535.487026:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966035840 00000100:00100000:2.0:1787383535.487030:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966035840 00000100:00100000:2.0:1787383535.487044:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966036096 00000100:00100000:2.0:1787383535.487046:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966036096 00000100:00100000:2.0:1787383535.487066:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1787383535.487075:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+15:2404:x1874206966035968:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383535.487089:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383535.487108:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600031400/0xc40acec91532fac1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402aec expref: 15 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383535.487125:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383535.487183:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+14:2404:x1874206966035968:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 108us (4958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383535.487203:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:2.0:1787383535.487219:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383535.487495:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+13:2404:x1874206966035840:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383535.487504:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383535.487523:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac8800/0xc40acec91532faba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402abb expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383535.487533:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383535.487553:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+12:2404:x1874206966035840:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 64us (4988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383535.487561:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383535.487574:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:2.0:1787383535.487581:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363db49050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+11:2404:x1874206966036096:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383535.487588:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383535.487596:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f7600/0xc40acec91532fb7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ba2 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383535.487606:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383535.487641:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363db49050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+10:2404:x1874206966036096:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 60us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383535.487663:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000001:00100000:2.0:1787383535.488622:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000020:00000080:2.0:1787383535.488628:0:19416:0:(genops.c:906:class_export_put()) final put ffff963622d86800/eeae0f85-81db-4a53-adaf-9a6519b93273 00000001:00100000:2.0:1787383535.488651:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000020:00000080:2.0:1787383535.488654:0:19416:0:(genops.c:906:class_export_put()) final put ffff96363ca40000/8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000020:00000080:1.0:1787383535.488853:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963622d86800/eeae0f85-81db-4a53-adaf-9a6519b93273 for lustre-OST0001 00000020:00000080:1.0:1787383535.488963:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363ca40000/8c365b90-f012-43f1-ab8b-e2f9eb08095c for lustre-OST0001 00000020:00000080:1.0:1787383535.488998:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963622d80800 for lustre-OST0001 00000020:00000080:1.0:1787383535.489010:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363ca46000 for lustre-OST0001 00000100:00100000:3.0:1787383535.496139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383535.497099:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966036992 00000100:00100000:0.0:1787383535.497110:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966036992 00000100:00100000:0.0:1787383535.497168:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1787383535.497178:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+16:2400:x1874206966036992:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:0.0:1787383535.497209:0:17096:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532facf 00000020:00010000:0.0:1787383535.497220:0:17096:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96363f99c000: total 0 00000100:00080000:0.0:1787383535.497711:0:17096:0:(import.c:65:import_set_state_nolock()) ffff96363f998000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787383535.497737:0:17096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:3.0:1787383535.497873:0:17082:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96363f99c000: total 0 00010000:00010000:3.0:1787383535.497921:0:17082:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96363f99c000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787383535.497983:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:3.0:1787383535.497987:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383535.497995:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91532fddf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c58 expref: 15 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498015:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff963628ebf800) 00010000:00010000:3.0:1787383535.498018:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383535.498022:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0800/0xc40acec91532fb9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ba9 expref: 14 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498040:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff96350244ba00) 00010000:00010000:3.0:1787383535.498054:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787383535.498060:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96363dac9e00/0xc40acec91532fc7a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402be8 expref: 13 pid: 17094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498079:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:3.0:1787383535.498081:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383535.498084:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec91532fd29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c27 expref: 12 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498097:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff963628ebf400) 00010000:00010000:3.0:1787383535.498099:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383535.498102:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0e00/0xc40acec91532fbb6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bb0 expref: 11 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498116:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff96350244b700) 00010000:00010000:3.0:1787383535.498118:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787383535.498122:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7000/0xc40acec91532fcf8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c12 expref: 10 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498136:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:3.0:1787383535.498139:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383535.498142:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0a00/0xc40acec91532fbf5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bbe expref: 9 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498153:0:17082:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff963628ebfa00) 00010000:00010000:3.0:1787383535.498155:0:17082:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383535.498159:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1200/0xc40acec91532fd84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c3c expref: 8 pid: 19236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383535.498184:0:17082:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96363f99c000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1787383535.498196:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383535.498198:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383535.498200:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383535.498717:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eeae0f85-81db-4a53-adaf-9a6519b93273+6:2400:x1874206966036992:12345-192.168.203.2@tcp:39:umount.0 Request processed in 1539us (2585us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1787383535.498727:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:1.0:1787383535.520392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383535.520489:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966037120 00000100:00100000:2.0:1787383535.520499:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966037120 00000100:00100000:2.0:1787383535.520564:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:2.0:1787383535.520573:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+5:2400:x1874206966037120:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:2.0:1787383535.520606:0:17095:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fad6 00000100:00080000:2.0:1787383535.520622:0:17095:0:(import.c:65:import_set_state_nolock()) ffff963638b79800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383535.520649:0:17095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787383535.520948:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383535.521171:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eeae0f85-81db-4a53-adaf-9a6519b93273+3:2400:x1874206966037120:12345-192.168.203.2@tcp:39:umount.0 Request processed in 598us (955us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787383535.521179:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000001:00100000:1.0:1787383535.778176:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000020:00000080:1.0:1787383535.778185:0:18596:0:(genops.c:906:class_export_put()) final put ffff96363cd58000/8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00100000:1.0:1787383535.778219:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000020:00000080:1.0:1787383535.778228:0:18596:0:(genops.c:906:class_export_put()) final put ffff96361122f800/eeae0f85-81db-4a53-adaf-9a6519b93273 00000020:00000080:2.0:1787383535.778337:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd58000/8c365b90-f012-43f1-ab8b-e2f9eb08095c for lustre-OST0000 00000020:00000080:2.0:1787383535.778401:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96361122f800/eeae0f85-81db-4a53-adaf-9a6519b93273 for lustre-OST0000 00000020:00000080:2.0:1787383535.778418:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363cd5d800 for lustre-OST0000 00000020:00000080:2.0:1787383535.778423:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96361122b800 for lustre-OST0000 00000100:00100000:3.0:1787383536.283153:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984988032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383536.283240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383536.283577:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988032 00000100:00100000:2.0:1787383536.283586:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988032 00000100:00100000:2.0:1787383536.283641:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787383536.283651:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984988032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383536.283686:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383536.283741:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984988032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383536.283749:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787383536.284288:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984988032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383536.284311:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383536.284318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984988160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383536.284350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383536.285298:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988160 00000100:00100000:2.0:1787383536.285311:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988160 00000100:00100000:2.0:1787383536.285374:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383536.285383:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984988160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383536.285421:0:17835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00010000:00010000:1.0:1787383536.285495:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383536.285519:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984988160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383536.285527:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383536.285671:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984988160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787383537.308071:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383537.539044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383537.539084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383537.539112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383537.539167:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966037248 00000100:00100000:3.0:1787383537.539176:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966037248 00000100:00100000:0.0:1787383537.539198:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966037376 00000100:00100000:0.0:1787383537.539204:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966037376 00000100:00100000:0.0:1787383537.539244:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966037504 00000100:00100000:0.0:1787383537.539247:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966037504 00000100:00100000:3.0:1787383537.539252:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:3.0:1787383537.539264:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67005cab-7d30-4f92-84d7-5c04932340db+12:2404:x1874206966037376:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383537.539308:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383537.539327:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f6c00/0xc40acec91532fb77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b9b expref: 12 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383537.539344:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383537.539403:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67005cab-7d30-4f92-84d7-5c04932340db+11:2404:x1874206966037376:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 142us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383537.539411:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:2.0:1787383537.539518:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383537.539529:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+10:2404:x1874206966037248:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383537.539539:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383537.539548:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030400/0xc40acec91532faf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b2b expref: 10 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383537.539558:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383537.539563:0:17080:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787383537.539581:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+9:2404:x1874206966037248:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 53us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383537.539587:0:17080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787383537.539592:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383537.539611:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:2.0:1787383537.539620:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+8:2402:x1874206966037504:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787383537.539901:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383537.539913:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f7200/0xc40acec91532fb00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402b5c expref: 8 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383537.539926:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383537.539953:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67005cab-7d30-4f92-84d7-5c04932340db+7:2402:x1874206966037504:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 334us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383537.539960:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:1.0:1787383537.544325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383537.544403:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966037760 00000100:00100000:3.0:1787383537.544413:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966037760 00000100:00100000:3.0:1787383537.544584:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383537.544602:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+6:2400:x1874206966037760:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:3.0:1787383537.544653:0:17094:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fb0e 00000020:00010000:3.0:1787383537.544662:0:17094:0:(genops.c:1942:obd_stale_export_put()) Put export ffff963622d80000: total 0 00000100:00080000:3.0:1787383537.544666:0:17094:0:(import.c:65:import_set_state_nolock()) ffff963622d84000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1787383537.544690:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:3.0:1787383537.544695:0:17094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:0.0:1787383537.544739:0:17083:0:(genops.c:1928:obd_stale_export_get()) Get export ffff963622d80000: total 0 00010000:00010000:0.0:1787383537.544743:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383537.544803:0:17083:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff963622d80000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787383537.544835:0:17083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff963628ebfe00) 00010000:00010000:0.0:1787383537.544838:0:17083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383537.544846:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91532fc03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402bc5 expref: 5 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383537.544869:0:17083:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff963622d80000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787383537.544880:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383537.544882:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383537.544884:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383537.544905:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c365b90-f012-43f1-ab8b-e2f9eb08095c+3:2400:x1874206966037760:12345-192.168.203.2@tcp:39:umount.0 Request processed in 311us (587us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1787383537.544914:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383537.556596:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383537.556814:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966037888 00000100:00100000:1.0:1787383537.556823:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966037888 00000100:00080000:0.0:1787383537.556949:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383537.557603:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:1.0:1787383537.557614:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+5:2400:x1874206966037888:12345-192.168.203.2@tcp:39:umount.0 00000020:00000080:1.0:1787383537.557654:0:19236:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532fb15 00000100:00080000:1.0:1787383537.557662:0:19236:0:(import.c:65:import_set_state_nolock()) ffff9636082d9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787383537.557694:0:19236:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1787383537.557851:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c365b90-f012-43f1-ab8b-e2f9eb08095c+3:2400:x1874206966037888:12345-192.168.203.2@tcp:39:umount.0 Request processed in 239us (1263us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787383537.557858:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00010000:00010000:3.0:1787383537.558181:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383537.582993:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383537.583603:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038144 00000100:00100000:3.0:1787383537.583612:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038144 00000100:00100000:3.0:1787383537.583669:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 170 00000100:00100000:3.0:1787383537.583678:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+7:2400:x1874206966038144:12345-192.168.203.2@tcp:251:umount.0 00000020:00000080:3.0:1787383537.583723:0:17089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532faac 00000020:00010000:3.0:1787383537.583731:0:17089:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96363f99e000: total 0 00000100:00080000:3.0:1787383537.583735:0:17089:0:(import.c:65:import_set_state_nolock()) ffff96363f99d000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787383537.583839:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67005cab-7d30-4f92-84d7-5c04932340db+3:2400:x1874206966038144:12345-192.168.203.2@tcp:251:umount.0 Request processed in 161us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383537.583850:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 170 00000020:00010000:0.0:1787383537.583851:0:17082:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96363f99e000: total 0 00010000:00010000:0.0:1787383537.583910:0:17082:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96363f99e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787383537.583945:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600031200/0xc40acec91532fab3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ab4 expref: 2 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383537.583958:0:17082:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96363f99e000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1787383537.583970:0:17082:0:(genops.c:906:class_export_put()) final put ffff96363f99e000/67005cab-7d30-4f92-84d7-5c04932340db 00010000:00010000:0.0:1787383537.583989:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383537.583991:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383537.583993:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383537.584029:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f99e000/67005cab-7d30-4f92-84d7-5c04932340db for MGS 00000020:00000080:3.0:1787383537.584119:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f99d000 for MGS 00010000:00010000:3.0:1787383538.334125:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383538.843824:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383538.843846:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984988288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383538.843918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.843978:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988288 00000100:00100000:0.0:1787383538.843985:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988288 00000100:00100000:0.0:1787383538.844033:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787383538.844043:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984988288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383538.844072:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383538.844111:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984988288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.844118:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787383538.844138:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383538.844172:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984988288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383538.845373:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984988544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383538.845411:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.845455:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988544 00000100:00100000:0.0:1787383538.845460:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988544 00000100:00100000:0.0:1787383538.845518:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787383538.845532:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984988544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383538.845547:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383538.845579:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504479c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206984988544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.845585:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787383538.845602:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787383538.845620:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383538.845626:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206984988544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383538.845629:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984988416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383538.845655:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.845679:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988416 00000100:00100000:0.0:1787383538.845683:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988416 00000100:00100000:0.0:1787383538.845707:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383538.845712:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984988416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383538.845727:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383538.845752:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984988416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.845758:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383538.845762:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350441ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984988800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.845792:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984988672:0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.845813:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.845814:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383538.845833:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984989312:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.845833:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984989184:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.845853:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383538.845865:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.845868:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984989696:0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.845881:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984989824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.845885:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383538.845897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.845901:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787383538.845906:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984989056:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.845925:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383538.845932:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984988416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383538.845941:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984989568:0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.845943:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383538.845947:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984988928:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.845965:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383538.845971:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988800 00000100:00100000:1.0:1787383538.845984:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988800 00000100:00100000:0.0:1787383538.845992:0:17086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988672 00000100:00100000:0.0:1787383538.845995:0:17086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988672 00000100:00100000:1.0:1787383538.846009:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989056 00000100:00100000:1.0:1787383538.846012:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989056 00000100:00100000:1.0:1787383538.846024:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383538.846024:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383538.846030:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984988800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.846030:0:17086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362cd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3648:x1874206984988672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.846058:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206984988800:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.846059:0:17086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362cd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3648:x1874206984988672:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383538.846065:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383538.846065:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787383538.846076:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787383538.846081:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984989056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.846089:0:19676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989184 00000100:00100000:0.0:1787383538.846092:0:19676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989184 00000100:00100000:1.0:1787383538.846104:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984989056:12345-0@lo:400:kworker.0 Request processed in 23us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383538.846110:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383538.846116:0:19676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383538.846122:0:19676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984989184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.846124:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989312 00000100:00100000:1.0:1787383538.846127:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989312 00000100:00100000:1.0:1787383538.846143:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989696 00000100:00100000:1.0:1787383538.846145:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989696 00000100:00100000:0.0:1787383538.846146:0:19676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206984989184:12345-0@lo:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.846151:0:19676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383538.846163:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989824 00000100:00100000:0.0:1787383538.846165:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989568 00000100:00100000:1.0:1787383538.846166:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989824 00000100:00100000:0.0:1787383538.846167:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989568 00000100:00100000:1.0:1787383538.846288:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787383538.846297:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984989312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.846325:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206984989312:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.850071:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787383538.850097:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984989696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.850181:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206984989696:12345-0@lo:400:kworker.0 Request processed in 97us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.850189:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787383538.850218:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787383538.850226:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984989824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851449:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206984989824:12345-0@lo:400:kworker.0 Request processed in 1219us (5545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.851470:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787383538.851503:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383538.851513:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984989568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851558:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206984989568:12345-0@lo:400:kworker.0 Request processed in 48us (5591us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.851565:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787383538.851623:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984989056:0@lo:400:kworker.0 00010000:00080000:0.0:1787383538.851637:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da0a680 x1874206984989568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383538.851647:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206984989568:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851657:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984988672:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851667:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206984989184:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851676:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206984989696:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.851746:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984989440:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383538.851806:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350441ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206984988800:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851817:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206984989312:0@lo:400:kworker.0 00010000:00080000:0.0:1787383538.851827:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da09180 x1874206984989824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383538.851835:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984989824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851860:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984988928 00000100:00100000:0.0:1787383538.851865:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984988928 00000100:00100000:0.0:1787383538.851899:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989440 00000100:00100000:0.0:1787383538.851901:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989440 00000100:00100000:0.0:1787383538.851917:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383538.851923:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984988928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.851955:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206984988928:12345-0@lo:400:kworker.0 Request processed in 32us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.851962:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787383538.851973:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383538.851978:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984989440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.852005:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206984989440:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383538.852011:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787383538.852033:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206984988928:0@lo:400:kworker.0 00000100:00100000:0.0:1787383538.852043:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984989440:0@lo:400:kworker.0 00000100:00100000:1.0:1787383538.852288:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1787383538.857254:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383538.857271:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383538.857274:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:2.0:1787383539.339469:0:20668:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:3.0:1787383539.356065:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787383539.365976:0:20668:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787383539.366034:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383539.366067:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383539.366073:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383539.366080:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383539.366102:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787383539.366107:0:20668:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787383539.366140:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383539.366144:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787383539.366150:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787383539.366172:0:20668:0:(import.c:65:import_set_state_nolock()) ffff96363db9f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787383539.366227:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984989952:0@lo:39:umount.0 00000100:00100000:3.0:1787383539.366292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383539.366361:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383539.366368:0:17082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.366375:0:17082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963600030a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383539.366378:0:17082:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.366386:0:17082:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383539.366404:0:17082:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383539.366410:0:17082:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383539.366412:0:17082:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787383539.366415:0:17082:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787383539.366449:0:17082:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.366456:0:17082:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383539.366475:0:17082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.366495:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963600030a00/0xc40acec91532f66f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f676 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.366506:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383539.366508:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383539.366510:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383539.366521:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984990080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383539.366550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383539.366618:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990080 00000100:00100000:0.0:1787383539.366624:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990080 00000100:00100000:0.0:1787383539.366669:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383539.366677:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3650:x1874206984990080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383539.366701:0:17079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383539.366716:0:17079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516d200/0xc40acec91532f676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f66f expref: 24 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.366738:0:17079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383539.366790:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:3650:x1874206984990080:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383539.366798:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383539.366836:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984990080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383539.367155:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984989952 00000100:00100000:1.0:1787383539.367160:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984989952 00000100:00100000:1.0:1787383539.367284:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787383539.367292:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874206984989952:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787383539.367323:0:17096:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f6a0 00000100:00080000:1.0:1787383539.367331:0:17096:0:(import.c:65:import_set_state_nolock()) ffff963635dfb800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787383539.367402:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383539.368518:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1874206984989952:12345-0@lo:39:umount.0 Request processed in 1222us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383539.368528:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1787383539.368539:0:17096:0:(genops.c:906:class_export_put()) final put ffff963635dff800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787383539.368704:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963635dff800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787383539.368783:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963635dfb800 for lustre-MDT0000 00000100:00080000:3.0:1787383539.369043:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787383539.369094:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984989952:0@lo:39:umount.0 00000100:00080000:2.0:1787383539.369148:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383539.369152:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787383539.369158:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787383539.371176:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371194:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371202:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371209:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371262:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383539.371269:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371277:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371283:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371302:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371333:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383539.371339:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371347:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383539.371351:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371359:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383539.371366:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383539.371379:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383539.371382:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787383539.371412:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371498:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787383539.371550:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787383539.371602:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371610:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f16e00/0xc40acec91532f5c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f5c7 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371625:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383539.371628:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371634:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383539.371638:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371644:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383539.371650:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383539.371655:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383539.371657:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1787383539.371669:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.371681:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787383539.371722:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984990336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383539.371935:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:3.0:1787383539.371940:0:20668:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787383539.371951:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371959:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371965:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371971:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371982:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383539.371986:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371993:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.371999:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.372005:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383539.372020:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787383539.372023:0:20668:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787383539.372026:0:20668:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787383539.372056:0:20668:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787383539.372060:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787383539.372064:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383539.372070:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787383539.372075:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9635035fd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383539.372080:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96361122a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383539.372085:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96363f9b6000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383539.372090:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff96363d875000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383539.372097:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff963622d80000 8c365b90-f012-43f1-ab8b-e2f9eb08095c 192.168.203.2@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1787383539.372102:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff96363f99c000 eeae0f85-81db-4a53-adaf-9a6519b93273 192.168.203.2@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1787383539.372107:0:20668:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff963503700000) has exports, disconnecting them 00000020:00080000:3.0:1787383539.372111:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9635035fd800), last request at 1787383538 00000020:00000080:3.0:1787383539.372118:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f8e5 00000100:00080000:3.0:1787383539.372135:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9635035f8000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383539.372175:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9635035fd800): rc 0 00000020:00000080:3.0:1787383539.372177:0:20668:0:(genops.c:906:class_export_put()) final put ffff9635035fd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787383539.372188:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96361122a000), last request at 1787383538 00000020:00000080:3.0:1787383539.372191:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f83d 00000100:00080000:3.0:1787383539.372196:0:20668:0:(import.c:65:import_set_state_nolock()) ffff963611228800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383539.372201:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96361122a000): rc 0 00000020:00000080:3.0:1787383539.372203:0:20668:0:(genops.c:906:class_export_put()) final put ffff96361122a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787383539.372206:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96363f9b6000), last request at 1787383469 00000020:00000080:3.0:1787383539.372215:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f78e 00000100:00080000:3.0:1787383539.372218:0:20668:0:(import.c:65:import_set_state_nolock()) ffff96363f9b0000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383539.372224:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363f9b6000): rc 0 00000020:00000080:3.0:1787383539.372226:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363f9b6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787383539.372231:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff96363d875000), last request at 1787383469 00000020:00000080:3.0:1787383539.372233:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f725 00000100:00080000:3.0:1787383539.372236:0:20668:0:(import.c:65:import_set_state_nolock()) ffff963638b7a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383539.372242:0:20668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1787383539.372306:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363d875000): rc 0 00000004:00000080:3.0:1787383539.372312:0:20668:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb73d81d77ae0 00000100:00080000:3.0:1787383539.372328:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787383539.372331:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787383539.373124:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787383539.373146:0:20668:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787383539.373183:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984990464:0@lo:39:umount.0 00000100:00100000:3.0:1787383539.373240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383539.373388:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990464 00000100:00100000:3.0:1787383539.373395:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990464 00000100:00100000:3.0:1787383539.373438:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383539.373446:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1874206984990464:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787383539.373472:0:17099:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f7b8 00000100:00080000:3.0:1787383539.373479:0:17099:0:(import.c:65:import_set_state_nolock()) ffff9636313f1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383539.373505:0:17099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787383539.373618:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3646:x1874206984990464:12345-0@lo:39:umount.0 Request processed in 172us (377us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787383539.373625:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787383539.373667:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787383539.373684:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984990464:0@lo:39:umount.0 00000100:00080000:3.0:1787383539.373738:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383539.373742:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1787383539.373753:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787383539.373840:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787383539.373851:0:20668:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787383539.373862:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383539.373865:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1787383539.373871:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383539.373930:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984990592:0@lo:9:umount.0 00000100:00100000:3.0:1787383539.373957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787383539.373984:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787383539.373994:0:20668:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787383539.374009:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984990720:0@lo:9:umount.0 00000100:00100000:3.0:1787383539.374031:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383539.374059:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990592 00000100:00100000:3.0:1787383539.374063:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990592 00000100:00100000:3.0:1787383539.374090:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990720 00000100:00100000:3.0:1787383539.374093:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990720 00000100:00100000:3.0:1787383539.374109:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383539.374114:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874206984990592:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787383539.374130:0:18600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f916 00000100:00080000:3.0:1787383539.374135:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96350453e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383539.374159:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787383539.374252:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1874206984990592:12345-0@lo:9:umount.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383539.374259:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787383539.374280:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383539.374285:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1874206984990720:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787383539.374296:0:18600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f91d 00000100:00080000:3.0:1787383539.374301:0:18600:0:(import.c:65:import_set_state_nolock()) ffff96350453a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787383539.374316:0:18600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787383539.374388:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3646:x1874206984990720:12345-0@lo:9:umount.0 Request processed in 102us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383539.374395:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787383539.374423:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635dfd800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787383539.374428:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787383539.374430:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383539.374432:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984990720:0@lo:9:umount.0 00000100:00080000:3.0:1787383539.374441:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d874000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787383539.374447:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787383539.374449:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383539.374451:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984990592:0@lo:9:umount.0 00000020:00080000:3.0:1787383539.374523:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff963503700000) has no exports 00010000:00010000:0.0:1787383539.374754:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383539.374782:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374792:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383539.374796:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374804:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383539.374812:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383539.374818:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787383539.374821:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787383539.374824:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787383539.374850:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374857:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383539.374874:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374892:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1800/0xc40acec91532fb69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532fb70 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374902:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383539.374906:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374911:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383539.374914:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374921:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383539.374927:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383539.374932:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787383539.374935:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787383539.374937:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787383539.374951:0:17083:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374957:0:17083:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383539.374964:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374971:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f16600/0xc40acec91532f5b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f5b9 expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.374990:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383539.374992:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383539.374993:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383539.375007:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984990848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383539.375039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383539.375070:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787383539.375075:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984990976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383539.375094:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383539.375117:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990848 00000100:00100000:0.0:1787383539.375121:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990848 00000100:00100000:0.0:1787383539.375149:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990976 00000100:00100000:0.0:1787383539.375151:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990976 00000100:00100000:0.0:1787383539.375168:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383539.375175:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+24:3649:x1874206984990848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383539.375185:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383539.375199:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f6400/0xc40acec91532fb70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532fb69 expref: 24 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.375211:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383539.375236:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+23:3649:x1874206984990848:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383539.375242:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383539.375255:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383539.375260:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:3649:x1874206984990976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383539.375267:0:17080:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383539.375275:0:17080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516c800/0xc40acec91532f5b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f5b2 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.375288:0:17080:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383539.375309:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3649:x1874206984990976:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383539.375315:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383539.375347:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984990976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383539.375355:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984990848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383539.375370:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383539.375469:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383539.375499:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984990208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383539.375521:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383539.375639:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990336 00000100:00100000:0.0:1787383539.375644:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990336 00000100:00100000:0.0:1787383539.375678:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984990208 00000100:00100000:0.0:1787383539.375681:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984990208 00000100:00100000:0.0:1787383539.375696:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383539.375703:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363db4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98408fb2-7fed-492b-911f-46eabbf1f8e3+22:3648:x1874206984990336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383539.375712:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383539.375721:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030000/0xc40acec91532f90f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f908 expref: 22 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.375731:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383539.375760:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363db4a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98408fb2-7fed-492b-911f-46eabbf1f8e3+21:3648:x1874206984990336:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383539.375787:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383539.375821:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383539.375827:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98408fb2-7fed-492b-911f-46eabbf1f8e3+20:3648:x1874206984990208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383539.375834:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383539.375841:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516d800/0xc40acec91532f5c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f5c0 expref: 20 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383539.375856:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383539.375878:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:98408fb2-7fed-492b-911f-46eabbf1f8e3+19:3648:x1874206984990208:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383539.375884:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383539.375927:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984990336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383539.375936:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984990208:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787383539.376307:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9635035fd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787383539.376351:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96361122a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787383539.376381:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f9b6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787383539.376401:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635035f8000 for lustre-MDT0000 00000020:00000080:2.0:1787383539.376406:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963611228800 for lustre-MDT0000 00000020:00000080:2.0:1787383539.376409:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f9b0000 for lustre-MDT0000 00010000:00010000:1.0:1787383539.376556:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.376566:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8e00/0xc40acec91532f908 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f90f expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383539.376578:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383539.376579:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383539.376582:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787383539.382095:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff963503700000) has no exports 00000020:00000080:3.0:1787383539.441350:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f60d 00000020:00000080:3.0:1787383539.441366:0:20668:0:(genops.c:906:class_export_put()) final put ffff963635058800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787383539.441435:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787383539.441640:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963635058800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787383539.441671:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383539.441681:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383539.441686:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9635033c4d40) has no exports 00000020:00000080:1.0:1787383539.443096:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f606 00000020:00000080:1.0:1787383539.443108:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363db98800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787383539.443163:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383539.443173:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787383539.443176:0:20668:0:(genops.c:906:class_export_put()) final put ffff9636064d7800/lustre-QMT0000_UUID 00000020:00000080:1.0:1787383539.443179:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9636064d7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787383539.443199:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787383539.443321:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363db98800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1787383540.379996:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383540.380658:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984991104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383540.380730:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383540.380834:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984991104 00000100:00100000:2.0:1787383540.380843:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984991104 00000100:00100000:2.0:1787383540.380915:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787383540.380925:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984991104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383540.380951:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1787383540.381016:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383540.384744:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984991104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3810us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383540.384757:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787383540.384887:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984991104:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1787383540.899237:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787383540.899254:0:17827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1787383540.899260:0:17827:0:(genops.c:906:class_export_put()) final put ffff963503c80800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787383540.899288:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00080000:2.0:1787383540.899294:0:17827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1787383540.899296:0:17827:0:(genops.c:906:class_export_put()) final put ffff9636082dc800/8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00100000:2.0:1787383540.899302:0:17827:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000001:00080000:2.0:1787383540.899314:0:17827:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1787383540.899317:0:17827:0:(genops.c:906:class_export_put()) final put ffff96350453a000/eeae0f85-81db-4a53-adaf-9a6519b93273 00000020:00000080:0.0:1787383540.899584:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963503c80800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787383540.899642:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9636082dc800/8c365b90-f012-43f1-ab8b-e2f9eb08095c for lustre-MDT0001 00000020:00000080:0.0:1787383540.899666:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96350453a000/eeae0f85-81db-4a53-adaf-9a6519b93273 for lustre-MDT0001 00000020:00000080:0.0:1787383540.899689:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9636313f1800 for lustre-MDT0001 00000020:00000080:0.0:1787383540.899694:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9636082d9000 for lustre-MDT0001 00000020:00000080:0.0:1787383540.899697:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963638b79800 for lustre-MDT0001 00000001:00100000:1.0:1787383540.906573:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787383540.906582:0:17074:0:(genops.c:906:class_export_put()) final put ffff96363d875000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787383540.906612:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00080000:1.0:1787383540.906620:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:1.0:1787383540.906624:0:17074:0:(genops.c:906:class_export_put()) final put ffff963622d80000/8c365b90-f012-43f1-ab8b-e2f9eb08095c 00000001:00100000:1.0:1787383540.906629:0:17074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eeae0f85-81db-4a53-adaf-9a6519b93273 00000001:00080000:1.0:1787383540.906633:0:17074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1787383540.906637:0:17074:0:(genops.c:906:class_export_put()) final put ffff96363f99c000/eeae0f85-81db-4a53-adaf-9a6519b93273 00000020:00000080:2.0:1787383540.906713:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d875000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1787383540.906796:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963622d80000/8c365b90-f012-43f1-ab8b-e2f9eb08095c for lustre-MDT0000 00000020:00000080:2.0:1787383540.906826:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f99c000/eeae0f85-81db-4a53-adaf-9a6519b93273 for lustre-MDT0000 00000020:00000080:2.0:1787383540.906866:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963638b7a000 for lustre-MDT0000 00000020:00000080:2.0:1787383540.906873:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963622d84000 for lustre-MDT0000 00000020:00000080:2.0:1787383540.906879:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f998000 for lustre-MDT0000 00000040:00080000:3.0:1787383541.147711:0:17848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787383541.405392:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383541.407079:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383541.407106:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984991232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383541.407197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383541.407454:0:17835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984991232 00000100:00100000:1.0:1787383541.407464:0:17835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984991232 00000100:00100000:1.0:1787383541.407531:0:17835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787383541.407538:0:17835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1874206984991232:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787383541.407547:0:17835:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787383541.407594:0:17835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3647:x1874206984991232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (395us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787383541.407601:0:17835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:02020000:0.0:1787383541.407699:0:3647:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1787383541.423261:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787383541.423271:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787383541.423275:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787383541.448334:0:3647:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383541.448354:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 502 00000100:00080000:0.0:1787383541.448373:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96363f937800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383541.448422:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503f22300 x1874206984991360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383541.449997:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984991360:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787383541.450113:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383541.453910:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984991360 00000100:00100000:2.0:1787383541.453924:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984991360 00000100:00100000:2.0:1787383541.453988:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787383541.453996:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984991360:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1787383541.454014:0:17100:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:01000000:1.0:1787383541.466957:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963635f40420 - data ffff96362902a948/ffff96362e6c8800 00000020:01000000:1.0:1787383541.467162:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9636039773c0 - data ffff963608a896c0/ffff963636893c00 00000100:00100000:2.0:1787383541.473097:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206984991360:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 19093us (22975us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383541.473111:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787383541.473221:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383541.473227:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383541.473231:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984991360:0@lo:38:ptlrpcd_00_00.0 00000001:00000004:1.0:1787383541.485413:0:20668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787383541.570456:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787383541.570477:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787383541.570493:0:20668:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff963608cf9500 x1874206984990464/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787383549 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383541.570519:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787383541.576139:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383541.576146:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787383541.576169:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383541.576184:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787383541.577232:0:17118:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787383541.577237:0:17118:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1787383541.577249:0:17118:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1787383541.578197:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383541.578203:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1787383541.578214:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383541.578216:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787383541.579225:0:17120:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787383541.579230:0:17120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1787383541.579238:0:17120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1787383541.584383:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f5d5 00000020:00000080:3.0:1787383541.584395:0:20668:0:(genops.c:906:class_export_put()) final put ffff9635046a7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787383541.584748:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635046a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787383541.587683:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f5ea 00000020:00000080:3.0:1787383541.587697:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363d875800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787383541.587719:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787383541.587725:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383541.587733:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787383541.587737:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff963503703380) has no exports 00000004:01000000:3.0:1787383541.587979:0:20668:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787383541.587988:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f64c 00000020:00000080:3.0:1787383541.587993:0:20668:0:(genops.c:906:class_export_put()) final put ffff963638b6e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787383541.587997:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787383541.588001:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383541.588006:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787383541.588009:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9636345a8000) has no exports 00000020:00000080:3.0:1787383541.588015:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f645 00000020:00000080:3.0:1787383541.588018:0:20668:0:(genops.c:906:class_export_put()) final put ffff963635df8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787383541.588659:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d875800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787383541.588672:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963638b6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787383541.588676:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963635df8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787383541.589591:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787383541.589597:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383541.589602:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1787383541.589609:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383541.589611:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383541.589663:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383541.589673:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383541.589681:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f637 00000020:00000080:3.0:1787383541.589689:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363d874800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787383541.589695:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787383541.589700:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383541.589707:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963635dfd800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787383541.589716:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1787383541.589716:0:36:0:(genops.c:906:class_export_put()) final put ffff96363d872800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:3.0:1787383541.589724:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff963503704d40) has no exports 00000020:00000080:2.0:1787383541.589725:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d872800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787383541.589733:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f630 00000020:01000000:2.0:1787383541.589734:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787383541.589738:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363d876800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787383541.589906:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d874800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1787383541.590667:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787383541.590672:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383541.590675:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:3.0:1787383541.590680:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787383541.590682:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383541.595396:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383541.595411:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1787383541.596196:0:20668:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1787383541.596207:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f622 00000020:00000080:3.0:1787383541.596216:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363d873800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787383541.596253:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1787383541.596262:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383541.596268:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787383541.596272:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9636352c8000) has no exports 00000020:00000080:3.0:1787383541.597157:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f61b 00000020:00000080:3.0:1787383541.597165:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363f98f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787383541.601203:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d876800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787383541.601223:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d874000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787383541.601232:0:36:0:(genops.c:906:class_export_put()) final put ffff96363d870800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787383541.601235:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d870800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787383541.601241:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787383541.601337:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d873800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787383541.601344:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f98f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787383541.601376:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787383541.601381:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787383541.601386:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383541.601392:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787383541.601458:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383541.601481:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787383541.601512:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383541.601516:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787383541.601519:0:20668:0:(genops.c:906:class_export_put()) final put ffff9635046a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787383541.601521:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9635046a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787383541.601525:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383541.601573:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f98c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787383541.601580:0:36:0:(genops.c:906:class_export_put()) final put ffff963611333000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787383541.601582:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963611333000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787383541.601604:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787383541.602947:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f5f1 00000020:00000080:2.0:1787383541.603112:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363d870000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787383541.603122:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787383541.603128:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383541.603135:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787383541.603139:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9635037019c0) has no exports 00000020:00000080:2.0:1787383541.603178:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383541.603183:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787383541.603187:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f5f8 00000020:00000080:2.0:1787383541.603191:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363d871000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787383541.603199:0:20668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963620e92000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787383541.603212:0:20668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620e92000 3 00000020:01000004:2.0:1787383541.603215:0:20668:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963620e92000 from lustre-MDT0000 00000020:00000080:2.0:1787383541.603233:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383541.603236:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787383541.603239:0:20668:0:(genops.c:906:class_export_put()) final put ffff9635046a0000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787383541.603241:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9635046a0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787383541.603249:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787383541.603291:0:20668:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787383541.603295:0:20668:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787383541.603298:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787383541.603300:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383541.603302:0:20668:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787383541.603308:0:20668:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff96363d9cf000 98408fb2-7fed-492b-911f-46eabbf1f8e3 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787383541.603314:0:20668:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9635033c19c0) has exports, disconnecting them 00000020:00080000:2.0:1787383541.603318:0:20668:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff96363d9cf000), last request at 1787383456 00000020:00000080:2.0:1787383541.603330:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f59d 00000020:00010000:2.0:1787383541.603333:0:20668:0:(genops.c:1942:obd_stale_export_put()) Put export ffff96363d9cf000: total 2 00000100:00080000:2.0:1787383541.603337:0:20668:0:(import.c:65:import_set_state_nolock()) ffff96363d9c9000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787383541.603348:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363d9cf000): rc 0 00000020:00080000:2.0:1787383541.603352:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9635033c19c0) has no exports 00000100:00100000:2.0:1787383541.603416:0:17089:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9635020af800:17089] 2 exiting: rc = 0 00000100:00100000:2.0:1787383541.603528:0:17086:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff96350230c000:17086] 0 exiting: rc = 1 00000020:00010000:1.0:1787383541.603666:0:18626:0:(genops.c:1928:obd_stale_export_get()) Get export ffff96363d9cf000: total 2 00000100:00100000:0.0:1787383541.603682:0:17088:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9635020af400:17088] 1 exiting: rc = 0 00010000:00010000:1.0:1787383541.603702:0:18626:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff96363d9cf000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787383541.603734:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8000/0xc40acec91532f828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f821 expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603761:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9800/0xc40acec91532fb54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532fb4d expref: 13 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603811:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9400/0xc40acec91532f779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f772 expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603824:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516d000/0xc40acec91532f6ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f6c3 expref: 11 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603847:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516da00/0xc40acec91532f6d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f6d1 expref: 10 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603886:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516c400/0xc40acec91532f5ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f5a4 expref: 9 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603899:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9000/0xc40acec91532f898 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f891 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603914:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f7000/0xc40acec91532fb46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532fb3f expref: 7 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603927:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1600/0xc40acec91532fb62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532fb5b expref: 6 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603943:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963610f17a00/0xc40acec91532f8c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f8bb expref: 5 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603960:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600030200/0xc40acec91532f901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f8fa expref: 4 pid: 17088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603981:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963600031000/0xc40acec91532f7fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f7f7 expref: 3 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.603996:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96360516de00/0xc40acec91532f6bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc40acec91532f6b5 expref: 2 pid: 17086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383541.604006:0:18626:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff96363d9cf000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787383541.604025:0:18626:0:(genops.c:906:class_export_put()) final put ffff96363d9cf000/98408fb2-7fed-492b-911f-46eabbf1f8e3 00010000:00010000:1.0:1787383541.604031:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383541.604032:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383541.604034:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787383541.604048:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d870000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787383541.604052:0:36:0:(genops.c:906:class_export_put()) final put ffff963611331000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787383541.604054:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963611331000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787383541.604057:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787383541.604094:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d871000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787383541.604099:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9cf000/98408fb2-7fed-492b-911f-46eabbf1f8e3 for MGS 00000020:00000080:1.0:1787383541.604124:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d9c9000 for MGS 00000100:00100000:2.0:1787383541.604576:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.604897:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.604909:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.604919:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.604926:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605015:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605025:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605034:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605045:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605051:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605406:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605414:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605421:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605428:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605435:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605443:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605451:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605460:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605478:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605484:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605495:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605501:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605548:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605557:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605565:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605575:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605582:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.605596:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606142:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606151:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606159:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606168:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606175:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606180:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606185:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606191:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606196:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606202:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606208:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606212:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606217:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606222:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606227:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606233:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606240:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606255:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606262:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606271:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606279:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606286:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606293:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606300:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606839:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606851:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606980:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.606993:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607006:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607018:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607029:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607039:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607047:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607052:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607058:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383541.607063:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787383541.616623:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963635f40ae0 - data ffff963501c19360/ffff96362e6ca000 00000020:01000000:2.0:1787383541.616843:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9636353030c0 - data ffff9636290a41b0/ffff963607449c00 00000020:00000080:3.0:1787383541.617488:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f581 00000020:00000080:3.0:1787383541.617498:0:20668:0:(genops.c:906:class_export_put()) final put ffff963504437000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787383541.617509:0:20668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963620e92000 from MGS, refs=2 00000020:01000004:3.0:1787383541.617513:0:20668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620e92000 2 00000020:01000004:3.0:1787383541.617516:0:20668:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963620e92000 from MGS 00000020:00000080:3.0:1787383541.617539:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383541.617546:0:20668:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787383541.617549:0:20668:0:(genops.c:906:class_export_put()) final put ffff963504433000/MGS 00000020:00000080:3.0:1787383541.617552:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff963504433000/MGS for MGS 00000020:01000000:3.0:1787383541.617558:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1787383541.617595:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963504437000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787383541.617631:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787383541.617636:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383541.617642:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787383541.617657:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff96363db9e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383541.617664:0:20668:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9635033c3380) has exports, disconnecting them 00000020:00080000:3.0:1787383541.617670:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff96363db9e800), last request at 1787383456 00000020:00000080:3.0:1787383541.617674:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f684 00000020:00080000:3.0:1787383541.617681:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363db9e800): rc 0 00000020:00000080:3.0:1787383541.617685:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363db9e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787383541.617727:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363db9e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787383541.618221:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787383541.618227:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383541.618231:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787383541.618236:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787383541.618388:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363db9f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787383541.618460:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383541.618477:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787383541.618482:0:20668:0:(genops.c:906:class_export_put()) final put ffff96363505c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787383541.618485:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff96363505c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787383541.618490:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787383541.618555:0:20668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620e92000 1 00000020:00000080:3.0:1787383541.618559:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f573 00000020:00000080:3.0:1787383541.618565:0:20668:0:(genops.c:906:class_export_put()) final put ffff963504434000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787383541.618570:0:20668:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787383541.618574:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383541.618577:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787383541.618580:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff963502738000) has no exports 00000020:00000080:1.0:1787383541.618671:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963504434000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787383541.668340:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383541.668353:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787383541.668359:0:20668:0:(genops.c:906:class_export_put()) final put ffff963620e92800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787383541.668363:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff963620e92800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787383541.668372:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787383541.668572:0:20668:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963620e90800 00000020:02000400:0.0:1787383541.668630:0:20668:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787383542.440686:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383543.453865:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383543.965463:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787383543.965471:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787383543.965475:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383543.965493:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 574 00000100:00080000:1.0:1787383543.965499:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787383543.965507:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff96363f937800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383543.965530:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363692bb80 x1874206984991616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383543.965733:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984991488:0@lo:400:kworker.0 00000400:00000100:2.0:1787383543.965797:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984991488 offset 0 length 224: 4 00000100:00100000:2.0:1787383543.965844:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984992128:0@lo:400:kworker.0 00000100:00100000:2.0:1787383543.965914:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383543.965943:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383543.965959:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984991744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383543.965998:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383543.966019:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984992256:0@lo:400:kworker.0 00000100:00100000:2.0:1787383543.966039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383543.966078:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984991744 00000100:00100000:2.0:1787383543.966087:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984991744 00000100:00100000:2.0:1787383543.966135:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787383543.966299:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984991744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383543.966350:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984991744:12345-0@lo:400:kworker.0 Request processed in 207us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383543.966671:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787383543.966717:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984991744:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.966892:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984991872:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.966922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383543.966938:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984992384:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.966968:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383543.966990:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787383543.966996:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984992000:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.967026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383543.967045:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984992512:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.967065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383543.967089:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992128 00000100:00100000:3.0:1787383543.967094:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992128 00000100:00100000:3.0:1787383543.967111:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992256 00000100:00100000:3.0:1787383543.967114:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992256 00000100:00100000:3.0:1787383543.967128:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992384 00000100:00100000:3.0:1787383543.967131:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992384 00000100:00100000:3.0:1787383543.967140:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992000 00000100:00100000:3.0:1787383543.967251:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992000 00000100:00100000:3.0:1787383543.967267:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992512 00000100:00100000:3.0:1787383543.967269:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992512 00000100:00100000:3.0:1787383543.967286:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383543.967292:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984992256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.967330:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206984992256:12345-0@lo:400:kworker.0 Request processed in 38us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383543.967349:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383543.967532:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383543.967540:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984992512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.967574:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1874206984992512:12345-0@lo:400:kworker.0 Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383543.967581:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787383543.967594:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383543.967599:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1874206984992128:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787383543.967604:0:19236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787383543.967627:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1874206984992128:12345-0@lo:400:kworker.0 Request processed in 27us (1713us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787383543.967642:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383543.967655:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383543.967659:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874206984992384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787383543.967664:0:19236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787383543.967687:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874206984992384:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787383543.967692:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383543.967703:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383543.967707:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874206984992000:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787383543.967711:0:19236:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787383543.967732:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1874206984992000:12345-0@lo:400:kworker.0 Request processed in 24us (705us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787383543.967737:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787383543.967752:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383543.967757:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787383543.967795:0:18600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984991872 00000100:00100000:3.0:1787383543.967798:0:18600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984991872 00010000:00080000:2.0:1787383543.968475:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff96363692ad80 x1874206984992256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383543.968541:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206984992256:0@lo:400:kworker.0 00000100:00080000:2.0:1787383543.968559:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787383543.968563:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787383543.968566:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787383543.970735:0:18600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383543.970747:0:18600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984991872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.970843:0:18600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206984991872:12345-0@lo:400:kworker.0 Request processed in 98us (3920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383543.970850:0:18600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787383543.970912:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787383543.970916:0:3647:0:(import.c:65:import_set_state_nolock()) ffff963638ad9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787383543.970919:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787383543.970924:0:3647:0:(import.c:65:import_set_state_nolock()) ffff963638ad9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383543.970938:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 502 00000100:00100000:0.0:1787383543.971095:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984991616:0@lo:38:kworker.0 00000100:00100000:0.0:1787383543.971198:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383543.971263:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383543.971270:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635037d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984992640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383543.971296:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383543.971330:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992640 00000100:00100000:0.0:1787383543.971443:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992640 00000100:00100000:0.0:1787383543.972033:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383543.972043:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984992640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383543.972063:0:18603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383543.972100:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206984992640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383543.972105:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787383543.972151:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635037d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206984992640:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1787383543.972683:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383543.973548:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff963638ad9000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383543.973577:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963608cf9500 x1874206984992768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383543.973624:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984992768:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787383543.973659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383543.973745:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206984992000:0@lo:400:kworker.0 00010000:00080000:3.0:1787383543.973778:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff963636928700 x1874206984992512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383543.973789:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984992512:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.973802:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984991872:0@lo:400:kworker.0 00000100:00080000:3.0:1787383543.973823:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787383543.973828:0:3647:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787383543.973831:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787383543.973835:0:3647:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383543.973839:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 530 00000100:00080000:3.0:1787383543.973843:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963503eeb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383543.973856:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963608cfb480 x1874206984992896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383543.974737:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984992896:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787383543.974791:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383543.975438:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206984992384:0@lo:400:kworker.0 00000100:00100000:3.0:1787383543.975514:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992768 00000100:00100000:3.0:1787383543.975520:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992768 00000100:00100000:3.0:1787383543.975545:0:19236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984992896 00000100:00100000:3.0:1787383543.975549:0:19236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984992896 00000100:00100000:3.0:1787383543.975561:0:19236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383543.975567:0:19236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1874206984992768:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1787383543.975596:0:19236:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787383543.976320:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787383543.976326:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984992896:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1787383543.976338:0:17094:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787383543.976396:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984992896:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 68us (1605us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787383543.976411:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787383543.980103:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383543.980115:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383543.980120:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984992896:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1787383544.002335:0:3649:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383544.002345:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 516 00000100:00080000:2.0:1787383544.002355:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96363cd5b000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383544.002512:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca50700 x1874206984993024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383544.002548:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206984992128:0@lo:400:kworker.0 00000100:00100000:2.0:1787383544.002590:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984993024:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787383544.002654:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383544.002711:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984991616 00000100:00100000:2.0:1787383544.002720:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984991616 00000100:00100000:2.0:1787383544.003205:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383544.003217:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984991616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787383544.003237:0:17099:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383544.003282:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984991616:12345-0@lo:38:kworker.0 Request processed in 65us (32084us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383544.003289:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383544.007349:0:17094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993024 00000100:00100000:2.0:1787383544.007889:0:17094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993024 00000100:00100000:2.0:1787383544.007934:0:17094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787383544.007941:0:17094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984993024:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1787383544.008913:0:17094:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383544.012512:0:17094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984993024:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4563us (9850us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383544.012527:0:17094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787383544.012592:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383544.012597:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383544.012601:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984993024:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787383544.012615:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383544.012618:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383544.012621:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984991616:0@lo:38:kworker.0 00000100:00100000:2.0:1787383544.058693:0:19236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1874206984992768:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 83118us (85026us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383544.058707:0:19236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787383544.058760:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963638ad9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383544.058957:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383544.058976:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206984992768:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1787383544.474938:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383544.995299:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787383544.995308:0:19416:0:(genops.c:906:class_export_put()) final put ffff96350453b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383544.996456:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96350453b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787383544.996502:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96350453a800 for lustre-OST0001 00000001:00100000:0.0:1787383544.997530:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383544.997536:0:18596:0:(genops.c:906:class_export_put()) final put ffff96350453f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787383544.997555:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96350453f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787383544.997575:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96350453e800 for lustre-OST0000 00000100:00100000:1.0:1787383545.500204:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383545.500224:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984993152:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383545.500280:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383545.500324:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993152 00000100:00100000:1.0:1787383545.500330:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993152 00000100:00100000:1.0:1787383545.500374:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383545.500382:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984993152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383545.500405:0:18604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383545.500453:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206984993152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383545.500460:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787383545.500478:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383545.500504:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206984993152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383545.518966:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383546.523977:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787383546.536041:0:20869:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787383546.547933:0:20869:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787383546.547990:0:20869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.548006:0:20869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.548024:0:20869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.548030:0:20869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.548047:0:20869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787383546.548052:0:20869:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787383546.548082:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383546.548086:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787383546.548091:0:20869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383546.548098:0:20869:0:(import.c:65:import_set_state_nolock()) ffff963638ad9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787383546.548102:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383546.548104:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787383546.548106:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787383546.548476:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383546.548483:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383546.548502:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516c000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383546.548506:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383546.548514:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383546.548539:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383546.548546:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787383546.548549:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787383546.548551:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787383546.548593:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383546.548600:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383546.548627:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383546.548633:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96360516c000/0xc40acec91532f772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f779 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383546.548645:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383546.548647:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383546.548648:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383546.548879:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984993280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383546.548940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383546.549001:0:17080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993280 00000100:00100000:1.0:1787383546.549008:0:17080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993280 00000100:00100000:1.0:1787383546.549045:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383546.549052:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874206984993280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787383546.549059:0:17080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383546 with bad export cookie 14126330544240391581 00010000:00010000:3.0:1787383546.549532:0:20869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549544:0:20869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549564:0:20869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549572:0:20869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549588:0:20869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383546.549594:0:20869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549600:0:20869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549607:0:20869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549613:0:20869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549684:0:20869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383546.549691:0:20869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549697:0:20869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549703:0:20869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549718:0:20869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549730:0:20869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787383546.549736:0:20869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549743:0:20869:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549750:0:20869:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549757:0:20869:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383546.549787:0:20869:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787383546.549791:0:20869:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787383546.549816:0:20869:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787383546.549819:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787383546.549824:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383546.549829:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787383546.550743:0:20869:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff96363f99c800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383546.550750:0:20869:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff96363f9b5800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383546.550755:0:20869:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff963627ae3380) has exports, disconnecting them 00000020:00080000:3.0:1787383546.550759:0:20869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96363f99c800), last request at 1787383543 00000020:00000080:3.0:1787383546.550786:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f8ec 00000100:00080000:3.0:1787383546.550802:0:20869:0:(import.c:65:import_set_state_nolock()) ffff96363f99b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383546.550921:0:20869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363f99c800): rc 0 00000020:00000080:3.0:1787383546.550924:0:20869:0:(genops.c:906:class_export_put()) final put ffff96363f99c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787383546.550940:0:20869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff96363f9b5800), last request at 1787383543 00000020:00000080:3.0:1787383546.550944:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f852 00000100:00080000:3.0:1787383546.550950:0:20869:0:(import.c:65:import_set_state_nolock()) ffff963622dcb800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787383546.550956:0:20869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363f9b5800): rc 0 00000020:00000080:3.0:1787383546.550958:0:20869:0:(genops.c:906:class_export_put()) final put ffff96363f9b5800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787383546.550964:0:20869:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb73d81d87ae0 00000100:00080000:3.0:1787383546.550981:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383546.550989:0:20869:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff963636929f80 x1874206984991232/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787383557 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383546.551004:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787383546.553026:0:20869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383546.553035:0:20869:0:(import.c:65:import_set_state_nolock()) ffff96363f937800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1787383546.553329:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f99c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1787383546.553438:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f9b5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787383546.553464:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f99b000 for lustre-MDT0001 00000020:00000080:0.0:1787383546.553484:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963622dcb800 for lustre-MDT0001 00010000:00010000:2.0:1787383546.555541:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787383546.555559:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.555573:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383546.555578:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.555589:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383546.555597:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383546.555603:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383546.555606:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787383546.555610:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1787383546.555656:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.555663:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787383546.556450:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984993408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383546.556524:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383546.556712:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556725:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532f6d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f6d8 expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556745:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383546.556779:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556787:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17600 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383546.556791:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556800:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383546.556807:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383546.556813:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383546.556816:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787383546.556819:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787383546.556843:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556850:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383546.556874:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556882:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91532f8fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f901 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556897:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383546.556902:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556908:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383546.556918:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556926:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383546.556933:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383546.556938:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787383546.556940:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787383546.556943:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787383546.556957:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556963:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383546.556970:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556976:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636421f6e00/0xc40acec91532fb5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532fb62 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556986:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383546.556989:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.556995:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8c00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383546.556998:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.557005:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383546.557018:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383546.557023:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383546.557025:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787383546.557027:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787383546.557040:0:18626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.557046:0:18626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787383546.557877:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984993792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383546.557949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383546.557988:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206984991232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383546.558035:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993408 00000100:00100000:0.0:1787383546.558043:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993408 00000100:00100000:0.0:1787383546.558076:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993792 00000100:00100000:0.0:1787383546.558078:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993792 00000100:00100000:0.0:1787383546.558091:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383546.558100:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963608cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1874206984993408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787383546.558107:0:17081:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383546 with bad export cookie 14126330544240391581 00010000:00010000:2.0:1787383546.565448:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.565471:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8c00/0xc40acec91532f6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc40acec91532f6ca expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383546.565505:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383546.565508:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383546.565511:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383546.565530:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383546.565571:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984993664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383546.566136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383546.566210:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383546.566219:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984993536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383546.566246:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383546.566278:0:17079:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787383546.566292:0:17079:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1787383546.566457:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383546.566498:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993664 00000100:00100000:2.0:1787383546.566512:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993664 00000100:00100000:2.0:1787383546.566547:0:17079:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787383546.566553:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993536 00000100:00100000:2.0:1787383546.566556:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993536 00000100:00100000:2.0:1787383546.568112:0:20870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383546.568124:0:20870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3647:x1874206984993792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787383546.568133:0:20870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383546 with bad export cookie 14126330544240391581 00000100:00100000:2.0:1787383546.568283:0:20870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3647:x1874206984993792:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (10333us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787383546.568292:0:20870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383546.568312:0:20870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383546.568317:0:20870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1874206984993664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787383546.568322:0:20870:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383546 with bad export cookie 14126330544240391581 00000100:00100000:2.0:1787383546.568357:0:20870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3650:x1874206984993664:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (2223us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787383546.568363:0:20870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787383546.568477:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787383546.568481:0:3650:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787383546.568485:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.102@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1787383546.569794:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963608cf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3648:x1874206984993408:12345-0@lo:103:ldlm_bl.0 Request processed in 11683us (13259us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787383546.569821:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787383546.569891:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787383546.575972:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.102@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787383546.578941:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1874206984993280:12345-0@lo:103:ldlm_bl.0 Request processed in 29883us (29996us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787383546.578969:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383546.579002:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383546.579008:0:17080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1874206984993536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787383546.579014:0:17080:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787383546 with bad export cookie 14126330544240391581 00000100:00100000:1.0:1787383546.579118:0:17080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3650:x1874206984993536:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (12870us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787383546.579125:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787383546.603555:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.102@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787383546.603561:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787383546.603569:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363692b480 x1874206984991488/t0(0) o400->MGC192.168.203.102@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787383559 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383546.603590:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963636929880 x1874206984993280/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383562 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383546.603600:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca50700 x1874206984993408/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383562 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383546.603631:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca51500 x1874206984993792/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383562 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383546.603639:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca50000 x1874206984993664/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383562 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383546.603648:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca52a00 x1874206984993536/t0(0) o103->MGC192.168.203.102@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787383562 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383546.603795:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96363d9cf800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787383546.603837:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:98408fb2-7fed-492b-911f-46eabbf1f8e3:3648:1874206984993408:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787383546.603985:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787383546.603990:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787383546.604013:0:20869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787383546.604077:0:20869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787383546.604110:0:20869:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787383546.604134:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787383546.604137:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1787383546.604154:0:20869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787383546.604232:0:20869:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787383546.604247:0:20869:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787383546.604294:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff963627ae3380) has no exports 00000100:00100000:3.0:1787383546.606934:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:98408fb2-7fed-492b-911f-46eabbf1f8e3:3649:1874206984991488:0@lo:400:kworker.0 10000000:01000000:2.0:1787383546.607063:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787383546.607067:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787383546.607069:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787383546.607073:0:3650:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383546.607078:0:3650:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 489 00000100:00080000:2.0:1787383546.607087:0:3650:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff96363d9cf800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383546.607103:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963608cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984993920:0@lo:9:umount.0 00000100:00100000:2.0:1787383546.607182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383546.607212:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984994048:0@lo:9:umount.0 00000100:00100000:2.0:1787383546.607295:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383546.607535:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984993920 00000100:00100000:2.0:1787383546.607543:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984993920 00000100:00100000:2.0:1787383546.607578:0:18599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984994048 00000100:00100000:2.0:1787383546.607581:0:18599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984994048 00000100:00100000:2.0:1787383546.607609:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383546.607616:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874206984993920:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787383546.607641:0:18599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f87c 00000100:00080000:2.0:1787383546.607648:0:18599:0:(import.c:65:import_set_state_nolock()) ffff96363cd5e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383546.607686:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787383546.607840:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1874206984993920:12345-0@lo:9:umount.0 Request processed in 223us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383546.607858:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383546.607872:0:18599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787383546.607878:0:18599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1874206984994048:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787383546.607891:0:18599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f924 00000100:00080000:2.0:1787383546.607896:0:18599:0:(import.c:65:import_set_state_nolock()) ffff963504538800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787383546.607919:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787383546.607993:0:18599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1874206984994048:12345-0@lo:9:umount.0 Request processed in 115us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383546.608000:0:18599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1787383546.608023:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383546.608045:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363505e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787383546.608055:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787383546.608057:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383546.608061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963608cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984993920:0@lo:9:umount.0 00000100:00080000:2.0:1787383546.608071:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787383546.608079:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787383546.608080:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383546.608082:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206984994048:0@lo:9:umount.0 00010000:00010000:2.0:1787383546.608097:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383546.608119:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363d133b80 x1874206984994176/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787383546.608144:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984994176:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1787383546.608163:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984994176 offset 0 length 520: 4 00000100:00100000:2.0:1787383546.608193:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984993536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383546.608199:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:98408fb2-7fed-492b-911f-46eabbf1f8e3:3650:1874206984993664:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787383546.609068:0:17090:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383546.611011:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff96363d9cf800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1787383546.611062:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984993280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383546.611099:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:98408fb2-7fed-492b-911f-46eabbf1f8e3:3647:1874206984993792:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787383546.618230:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff963627ae3380) has no exports 00000020:01000000:2.0:1787383546.676591:0:20869:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963503083120 - data ffff963629152e58/ffff963604aac000 00000020:01000000:0.0:1787383546.680091:0:20869:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963602ad1900 - data ffff96361938baf8/ffff96360499c800 00000001:00000004:0.0:1787383546.694985:0:20869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787383546.774504:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383546.774512:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787383546.774519:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787383546.777578:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787383546.777585:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787383546.778192:0:20869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383546.778196:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787383546.780841:0:17836:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787383546.780848:0:17836:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787383546.780870:0:17836:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787383546.781460:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787383546.781465:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787383546.781484:0:20869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383546.781486:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787383546.781890:0:17838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787383546.781894:0:17838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787383546.781915:0:17838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787383546.782876:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f6e6 00000020:00000080:2.0:1787383546.782886:0:20869:0:(genops.c:906:class_export_put()) final put ffff963638b6c800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383546.783187:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963638b6c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787383546.783745:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f6fb 00000020:00000080:2.0:1787383546.783750:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635046a4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787383546.783852:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787383546.783858:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383546.783866:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787383546.783870:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9635033c0000) has no exports 00000004:01000000:2.0:1787383546.784064:0:20869:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787383546.784072:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f74f 00000020:00000080:2.0:1787383546.784076:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635036f3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383546.788228:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635046a4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787383546.793515:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787383546.793530:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383546.793541:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787383546.793546:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9636345acd40) has no exports 00000020:00000080:2.0:1787383546.793556:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f748 00000020:00000080:2.0:1787383546.793565:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635036f7000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383546.801925:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f3800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1787383546.802558:0:20869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787383546.802573:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787383546.802577:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1787383546.802583:0:20869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383546.802585:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383546.802613:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787383546.807887:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635036f7800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787383546.807984:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383546.807998:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383546.808003:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635036f3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787383546.808006:0:20869:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787383546.808020:0:20869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383546.808110:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f73a 00000020:00000080:2.0:1787383546.808116:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635036f2000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787383546.808191:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787383546.808197:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383546.808202:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787383546.808206:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff963627ae4d40) has no exports 00000020:00000080:2.0:1787383546.808215:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f733 00000020:00000080:2.0:1787383546.808220:0:20869:0:(genops.c:906:class_export_put()) final put ffff96363505f800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383546.816661:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635036f2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1787383546.817337:0:20869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787383546.817343:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787383546.817353:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1787383546.817360:0:20869:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787383546.817362:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383546.823628:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363505f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787383546.823943:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383546.823956:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787383546.823971:0:20869:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787383546.823978:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f71e 00000020:00000080:2.0:1787383546.823986:0:20869:0:(genops.c:906:class_export_put()) final put ffff96363d877800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787383546.824012:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1787383546.824018:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383546.824023:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787383546.824027:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9636345ab380) has no exports 00000020:00000080:2.0:1787383546.824055:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f717 00000020:00000080:2.0:1787383546.824059:0:20869:0:(genops.c:906:class_export_put()) final put ffff963636f5e000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787383546.824195:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363505e800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787383546.824202:0:36:0:(genops.c:906:class_export_put()) final put ffff963638b69000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383546.824204:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963638b69000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787383546.824211:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383546.824298:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d877800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787383546.824304:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963636f5e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787383546.833830:0:20869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787383546.833839:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787383546.833844:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787383546.833851:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383546.833896:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383546.833908:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383546.833947:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383546.833950:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383546.833956:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635034f3800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787383546.833960:0:20869:0:(genops.c:865:class_export_destroy()) destroying export ffff9635034f3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787383546.833971:0:20869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787383546.834131:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f702 00000020:00000080:3.0:1787383546.834139:0:20869:0:(genops.c:906:class_export_put()) final put ffff9635046a1800/lustre-MDD0001_UUID 00000020:01000000:3.0:1787383546.834144:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787383546.834148:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383546.834152:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787383546.834156:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff963627ae0000) has no exports 00000020:00000080:3.0:1787383546.834176:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383546.834179:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787383546.834182:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f709 00000020:00000080:3.0:1787383546.834185:0:20869:0:(genops.c:906:class_export_put()) final put ffff96362254f800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787383546.834192:0:20869:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963636f5c800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787383546.834195:0:20869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963636f5c800 2 00000020:01000004:3.0:1787383546.834197:0:20869:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963636f5c800 from lustre-MDT0001 00000020:00000080:3.0:1787383546.834212:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383546.834215:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787383546.834217:0:20869:0:(genops.c:906:class_export_put()) final put ffff963638b6f000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787383546.834219:0:20869:0:(genops.c:865:class_export_destroy()) destroying export ffff963638b6f000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787383546.834225:0:20869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787383546.834263:0:20869:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787383546.834267:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787383546.834270:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383546.834273:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787383546.834279:0:20869:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff963638adc800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383546.834283:0:20869:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff96350273cd40) has exports, disconnecting them 00000020:00080000:3.0:1787383546.834288:0:20869:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff963638adc800), last request at 1787383469 00000020:00000080:3.0:1787383546.834291:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f787 00000020:00080000:3.0:1787383546.834309:0:20869:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963638adc800): rc 0 00000020:00000080:3.0:1787383546.834313:0:20869:0:(genops.c:906:class_export_put()) final put ffff963638adc800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787383546.834979:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363f937800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787383546.834989:0:36:0:(genops.c:906:class_export_put()) final put ffff963635df9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787383546.834991:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963635df9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787383546.835007:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787383546.835087:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9635046a1800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787383546.835090:0:36:0:(genops.c:906:class_export_put()) final put ffff96362d8ae800/lustre-MDD0001_UUID 00000020:00000080:1.0:1787383546.835093:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96362d8ae800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787383546.835096:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787383546.835184:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96362254f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787383546.835188:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963638adc800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1787383546.936232:0:20869:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1787383546.936303:0:20869:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383546.936307:0:20869:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383546.936315:0:20869:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787383546.936491:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963638ad9000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787383546.936579:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383546.936587:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787383546.936592:0:20869:0:(genops.c:906:class_export_put()) final put ffff963638b7f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787383546.936596:0:20869:0:(genops.c:865:class_export_destroy()) destroying export ffff963638b7f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787383546.936605:0:20869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1787383546.938883:0:20869:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963636f5c800 1 00000020:00000080:2.0:1787383546.938896:0:20869:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f6ae 00000020:00000080:2.0:1787383546.938903:0:20869:0:(genops.c:906:class_export_put()) final put ffff963635dfb000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1787383546.939444:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1787383546.939453:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383546.939461:0:20869:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787383546.939465:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9636352ccd40) has no exports 00000020:00000080:1.0:1787383546.942656:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963635dfb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787383547.090258:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383547.090270:0:20869:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787383547.090275:0:20869:0:(genops.c:906:class_export_put()) final put ffff963636f5f800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787383547.090280:0:20869:0:(genops.c:865:class_export_destroy()) destroying export ffff963636f5f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787383547.090290:0:20869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787383547.090411:0:20869:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963636f5e800 00000020:01000000:2.0:1787383547.090441:0:20869:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787383547.090445:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383547.090449:0:20869:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787383547.090453:0:20869:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9635027399c0) has no exports 00000100:00100000:2.0:1787383547.090523:0:17095:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff96360937a600:17095] 1 exiting: rc = 0 00000100:00100000:2.0:1787383547.090608:0:19236:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9635021bb000:19236] 3 exiting: rc = 0 00000100:00100000:3.0:1787383547.090735:0:17096:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff96360937be00:17096] 2 exiting: rc = 0 00000100:00100000:0.0:1787383547.092610:0:17094:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff96360937b400:17094] 0 exiting: rc = 1 00000100:00100000:2.0:1787383547.094043:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094071:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094078:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094084:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094090:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094096:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094102:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094108:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094114:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094120:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094126:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094132:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094137:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094143:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094150:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094157:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094162:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094168:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094174:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094180:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094186:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094192:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094196:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094202:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094207:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094212:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094217:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094238:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094252:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094261:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094266:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094272:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094277:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094283:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094289:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094296:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094311:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094318:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094324:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094330:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094334:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094340:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094345:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094350:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094355:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094362:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094368:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094374:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094379:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094385:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094463:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094469:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094474:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094479:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094487:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094494:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094499:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094505:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094510:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094516:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094521:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094526:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094532:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.094537:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.105267:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff96360937a400:17098] 1 exiting: rc = 0 00000100:00100000:3.0:1787383547.105635:0:17097:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff96360937ac00:17097] 0 exiting: rc = 1 00000100:00100000:2.0:1787383547.105834:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105843:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105850:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105856:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105861:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105867:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105872:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105890:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105894:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105899:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105904:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105909:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105914:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105919:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105925:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105929:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105934:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105939:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105944:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105949:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105954:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105958:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105964:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105969:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105974:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105979:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105985:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105990:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.105995:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106003:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106009:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106014:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106019:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106025:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106030:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106035:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106041:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106046:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106051:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106056:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106061:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106067:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106080:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106086:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106091:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106097:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106102:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106109:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106115:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106120:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106126:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106131:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106137:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106142:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106147:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106152:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106157:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106162:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106168:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106174:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106180:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106185:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106190:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106197:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.106652:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff96363db95e00:17099] 0 exiting: rc = 1 00000100:00100000:2.0:1787383547.106714:0:17835:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff96363da53000:17835] 2 exiting: rc = 0 00000100:00100000:1.0:1787383547.107039:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff96363db94400:17100] 1 exiting: rc = 0 00000100:00100000:2.0:1787383547.107508:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107516:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107522:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107528:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107533:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107539:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107544:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107550:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107555:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107562:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107567:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107583:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107588:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107607:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107614:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107620:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107627:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107632:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107637:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107643:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107649:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107654:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107669:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107675:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107687:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107718:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107726:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107747:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107753:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107758:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107795:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107802:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107808:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107814:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107820:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107826:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107832:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107856:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107864:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107869:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107875:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107880:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107885:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107891:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107897:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107903:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107915:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107920:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107926:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107946:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107953:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107959:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107964:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107970:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107976:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107981:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107987:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107992:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.107998:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.108003:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.108009:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.108017:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.108023:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.108037:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157336:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff96360af82800:17102] 1 exiting: rc = 0 00000100:00100000:1.0:1787383547.157483:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff96360af82c00:17101] 0 exiting: rc = 1 00000100:00100000:3.0:1787383547.157709:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157716:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157721:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157727:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157733:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157739:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157743:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157748:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157752:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157757:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157791:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157799:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157804:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157810:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157814:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157819:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157823:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157828:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157834:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157838:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157843:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157847:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157852:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157857:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157862:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157867:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157872:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157876:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157880:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157898:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157903:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157909:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157914:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157919:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157924:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157930:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157935:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157940:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157945:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157950:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157955:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157959:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157963:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157967:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157971:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157975:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157979:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157984:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157988:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157992:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.157997:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158002:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158007:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158011:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158016:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158021:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158025:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158061:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158066:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158071:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158076:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158080:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158084:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.158090:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383547.158501:0:17104:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff963635271400:17104] 1 exiting: rc = 0 00000100:00100000:1.0:1787383547.159217:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff963635271c00:17103] 0 exiting: rc = 1 00000100:00100000:3.0:1787383547.159467:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159475:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159480:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159485:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159491:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159497:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159501:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159506:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159510:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159515:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159520:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159524:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159529:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159533:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159538:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159543:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159547:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159553:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159558:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159564:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159569:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159574:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159579:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159583:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159589:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159594:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159599:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159604:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159608:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159613:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159619:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159624:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159629:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159634:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159639:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159660:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159665:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159670:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159674:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159678:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159683:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159688:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159693:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159697:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159702:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159707:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159712:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159717:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159722:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159727:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159732:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159737:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159741:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159746:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159751:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159756:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.159761:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160062:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160068:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160073:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160078:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160083:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160088:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383547.160093:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.161560:0:17105:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff963635271600:17105] 0 exiting: rc = 1 00000100:00100000:3.0:1787383547.161719:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff963635271200:17106] 1 exiting: rc = 0 00000100:00100000:0.0:1787383547.161865:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161872:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161876:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161881:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161898:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161903:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161908:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161913:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161918:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161924:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161929:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161934:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161938:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161943:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161948:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161954:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161958:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161964:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161969:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161974:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161979:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161984:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161989:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.161994:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162000:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162005:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162010:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162016:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162020:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162025:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162030:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162035:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162039:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162044:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162048:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162053:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162058:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162063:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162069:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162082:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162087:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162093:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162099:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162104:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162109:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162115:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162120:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162125:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162130:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162136:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162142:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162147:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162153:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162159:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162164:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162169:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162174:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162179:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162185:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162190:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162195:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162201:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162206:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.162212:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383547.168262:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff963503176a00:17107] 0 exiting: rc = 1 00000100:00100000:0.0:1787383547.168648:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff963607f10400:17109] 2 exiting: rc = 0 00000100:00100000:3.0:1787383547.171660:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff963607f10000:17108] 1 exiting: rc = 0 00000100:00100000:0.0:1787383547.171872:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171880:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171886:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171892:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171897:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171904:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171910:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171917:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171923:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171944:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171950:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171955:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171961:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171967:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171973:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171978:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171984:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171990:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.171995:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172002:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172007:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172014:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172038:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172045:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172051:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172057:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172062:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172068:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172073:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172079:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172085:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172091:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172096:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172102:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172107:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172111:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172117:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172123:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172129:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172134:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172139:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172145:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172151:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172156:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172169:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172174:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172195:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172201:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172206:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172212:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172217:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172222:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172227:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172233:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172239:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172255:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172263:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172268:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172273:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172278:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172284:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172289:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172295:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383547.172300:0:20869:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787383547.178749:0:20869:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383547.178996:0:20869:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787383547.179003:0:20869:0:(genops.c:906:class_export_put()) final put ffff96362d8ab000/MDS_uuid 00000020:00000080:0.0:1787383547.179008:0:20869:0:(genops.c:865:class_export_destroy()) destroying export ffff96362d8ab000/MDS_uuid for MDS 00000020:01000000:0.0:1787383547.179013:0:20869:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787383547.179160:0:20869:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1787383547.547780:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383548.572267:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787383549.084135:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383549.084149:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383549.084153:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383549.084157:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383549.084161:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383549.084169:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 577 00000100:00080000:0.0:1787383549.084190:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383549.084197:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96363cd5b000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383549.084235:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e93800 x1874206984994304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383549.084304:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383549.084308:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787383549.084310:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383549.084314:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 577 00000100:00080000:0.0:1787383549.084316:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383549.084320:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963503eeb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383549.084332:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e90000 x1874206984994560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383549.084380:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383549.084397:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984994432:0@lo:400:kworker.0 00000400:00000100:0.0:1787383549.084458:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984994432 offset 0 length 224: 4 00000100:00100000:0.0:1787383549.084496:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984994688:0@lo:400:kworker.0 00000400:00000100:0.0:1787383549.084514:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984994688 offset 0 length 224: 4 00000100:00100000:2.0:1787383549.084693:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984994304:0@lo:38:kworker.0 00000400:00000100:2.0:1787383549.084719:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984994304 offset 0 length 520: 4 00000100:00100000:2.0:1787383549.084733:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984994560:0@lo:38:kworker.0 00000400:00000100:2.0:1787383549.084749:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984994560 offset 0 length 520: 4 00010000:00010000:2.0:1787383549.594936:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383550.619961:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787383551.133472:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383551.133481:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383551.133484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383551.133501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383551.133555:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787383551.133558:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383551.133594:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984994944:0@lo:400:kworker.0 00000400:00000100:2.0:1787383551.133641:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984994944 offset 0 length 224: 4 00000100:00100000:3.0:1787383551.135589:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984994816:0@lo:400:kworker.0 00000400:00000100:3.0:1787383551.135688:0:3650:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984994816 offset 0 length 224: 4 00010000:00010000:1.0:1787383551.645979:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787383551.842884:0:21071:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787383551.870292:0:21071:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787383551.870347:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383551.870362:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383551.870369:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383551.870388:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383551.870462:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787383551.870470:0:21071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787383551.870498:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383551.870510:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503e93800 x1874206984994304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383551.870533:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383551.870539:0:21071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787383551.870546:0:21071:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787383551.870550:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383551.870553:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503e93800 x1874206984994304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383564 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383551.870561:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383551.870564:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1787383551.870630:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206984994304:0@lo:38:kworker.0 00000100:00080000:0.0:1787383551.872888:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383551.872904:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503e93b80 x1874206984994432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383551.872924:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363d131500 x1874206984994816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383551.872940:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383551.872945:0:21071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787383551.872965:0:21071:0:(import.c:65:import_set_state_nolock()) ffff9635036f5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787383551.873115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206984994432:0@lo:400:kworker.0 00000100:00100000:1.0:1787383551.873278:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206984994816:0@lo:400:kworker.0 00000100:00100000:3.0:1787383551.873361:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984995072:0@lo:39:umount.0 00000400:00000100:3.0:1787383551.873413:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995072 offset 0 length 224: 4 00010000:00010000:2.0:1787383551.878293:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383551.878307:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383551.878318:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383551.878322:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383551.878333:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383551.878341:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383551.878346:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383551.878349:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787383551.878352:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787383551.878370:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:2.0:1787383551.878374:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383551.878381:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f17e00/0xc40acec91532f821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f828 expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383551.878424:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383551.878426:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383551.878428:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787383552.161494:0:18596:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787383552.161507:0:18596:0:(genops.c:906:class_export_put()) final put ffff96363cd59000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787383552.161728:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff96363cd59000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000001:00100000:2.0:1787383552.167597:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787383552.167606:0:19416:0:(genops.c:906:class_export_put()) final put ffff963504539800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787383552.170721:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363cd5e000 for lustre-OST0000 00000020:00000080:1.0:1787383552.174143:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff963504539800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787383552.174206:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963504538800 for lustre-OST0001 00010000:00010000:1.0:1787383552.666965:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383553.691296:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383554.138941:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383554.138951:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383554.138965:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383554.138968:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383554.139120:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984995200:0@lo:400:kworker.0 00000400:00000100:1.0:1787383554.139169:0:3648:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995200 offset 0 length 224: 4 00010000:00010000:2.0:1787383554.717496:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383555.739150:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383556.763627:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383557.018887:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383546/real 1787383546] req@ffff96363d133b80 x1874206984994176/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383556 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383557.018918:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363d133b80 x1874206984994176/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383556 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383557.018936:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383557.018960:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787383557.018964:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984994176:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787383557.019048:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383557.019053:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787383557.019056:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383557.019061:0:13975:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1787383557.019066:0:13975:0:(import.c:589:import_select_connection()) MGC192.168.203.102@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383557.019080:0:13975:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff96363d9cf800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383557.019110:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e90a80 x1874206984995328/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383557.019133:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787383557.019137:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383557.019420:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984995328:0@lo:250:kworker.0 00000400:00000100:2.0:1787383557.019465:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984995328 offset 0 length 520: 4 00000100:00100000:1.0:1787383557.022082:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984995456:0@lo:400:kworker.0 00000400:00000100:1.0:1787383557.022134:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995456 offset 0 length 224: 4 00010000:00010000:2.0:1787383557.787503:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383558.811820:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383559.836918:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383560.860954:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383561.114888:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383551/real 1787383551] req@ffff963503e92a00 x1874206984995072/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383561.114918:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e92a00 x1874206984995072/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383561.114950:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635036f5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787383561.114967:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206984995072:0@lo:39:umount.0 00000100:00080000:0.0:1787383561.117420:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383561.117428:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383561.117436:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787383561.118437:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118453:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118461:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118468:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118497:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383561.118504:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118527:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118534:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118541:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383561.118562:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787383561.118567:0:21071:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787383561.118591:0:21071:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787383561.118596:0:21071:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787383561.118600:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383561.118605:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383561.118609:0:21071:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9636345a99c0) has no exports 00000020:00080000:0.0:1787383561.118630:0:21071:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9636345a99c0) has no exports 00010000:00010000:2.0:1787383561.120399:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383561.120411:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120423:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516dc00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383561.120427:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120438:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383561.120446:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383561.120452:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383561.120454:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787383561.120457:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787383561.120474:0:18626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:2.0:1787383561.120478:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120484:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96360516dc00/0xc40acec91532f7f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f7fe expref: -99 pid: 18595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120498:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383561.120502:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120507:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0000 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383561.120510:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120532:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383561.120539:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383561.120544:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787383561.120546:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787383561.120548:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787383561.120553:0:18626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:2.0:1787383561.120556:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120562:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0000/0xc40acec91532fb4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532fb54 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383561.120570:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383561.120572:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383561.120574:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383561.120653:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787383561.121297:0:21071:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff96363d860480 - data ffff963629232ca8/ffff9635024bc800 00000020:01000000:0.0:1787383561.121415:0:21071:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff963635f403c0 - data ffff963501c211b0/ffff963503f9c800 00100000:10000000:0.0:1787383561.134323:0:21071:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787383561.143213:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f80c 00000020:00000080:1.0:1787383561.143226:0:21071:0:(genops.c:906:class_export_put()) final put ffff9636350b2800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787383561.143235:0:21071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963638ad9800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787383561.143238:0:21071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963638ad9800 2 00000020:01000004:1.0:1787383561.143241:0:21071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963638ad9800 from lustre-OST0000 00000020:00000080:1.0:1787383561.143259:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787383561.143266:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787383561.143268:0:21071:0:(genops.c:906:class_export_put()) final put ffff9636350b3000/lustre-OST0000_UUID 00000020:00000080:1.0:1787383561.143356:0:21071:0:(genops.c:865:class_export_destroy()) destroying export ffff9636350b3000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787383561.143365:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1787383561.143376:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff9636350b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1787383561.143422:0:21071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787383561.143426:0:21071:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787383561.143438:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787383561.143444:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787383561.143455:0:21071:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff96363505d000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787383561.143462:0:21071:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff96363cd50000) has exports, disconnecting them 00000020:00080000:1.0:1787383561.143468:0:21071:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff96363505d000), last request at 1787383483 00000020:00000080:1.0:1787383561.143472:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f836 00000020:00080000:1.0:1787383561.143484:0:21071:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363505d000): rc 0 00000020:00000080:1.0:1787383561.143490:0:21071:0:(genops.c:906:class_export_put()) final put ffff96363505d000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787383561.143529:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363505d000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787383561.147304:0:21071:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787383561.147314:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383561.147319:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787383561.147325:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787383561.147380:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363cd5b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787383561.147479:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383561.147490:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1787383561.147495:0:21071:0:(genops.c:906:class_export_put()) final put ffff963620411000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787383561.147499:0:21071:0:(genops.c:865:class_export_destroy()) destroying export ffff963620411000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787383561.147519:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787383561.147584:0:21071:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787383561.147589:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383561.147594:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787383561.147600:0:21071:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff96363f9b6800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787383561.147605:0:21071:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff963627ae19c0) has exports, disconnecting them 00000020:00080000:0.0:1787383561.147610:0:21071:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff96363f9b6800), last request at 1787383483 00000020:00000080:0.0:1787383561.147613:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f84b 00000020:00080000:0.0:1787383561.147626:0:21071:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff96363f9b6800): rc 0 00000020:00000080:0.0:1787383561.147630:0:21071:0:(genops.c:906:class_export_put()) final put ffff96363f9b6800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787383561.147754:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff96363f9b6800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787383561.148399:0:21071:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787383561.148403:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383561.148406:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787383561.148411:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383561.148538:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383561.148544:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787383561.148549:0:21071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963638ad9800 1 00000020:00000080:0.0:1787383561.148554:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f7e9 00000020:00000080:0.0:1787383561.148559:0:21071:0:(genops.c:906:class_export_put()) final put ffff963640942000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787383561.148563:0:21071:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787383561.148566:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383561.148569:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787383561.148573:0:21071:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff96350273b380) has no exports 00000020:00000080:3.0:1787383561.148603:0:13975:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635036f5800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787383561.148612:0:13975:0:(genops.c:906:class_export_put()) final put ffff963635059000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787383561.148614:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963635059000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787383561.148621:0:13975:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787383561.148695:0:13975:0:(genops.c:865:class_export_destroy()) destroying export ffff963640942000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787383561.170123:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383561.170138:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787383561.170144:0:21071:0:(genops.c:906:class_export_put()) final put ffff963638adc000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787383561.170148:0:21071:0:(genops.c:865:class_export_destroy()) destroying export ffff963638adc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787383561.170162:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787383561.170390:0:21071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963638add000 00000020:02000400:2.0:1787383561.170450:0:21071:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787383561.895803:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383562.401963:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383562.401972:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383562.401976:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383562.401979:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383562.402059:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383562.402077:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984995584:0@lo:400:kworker.0 00000400:00000100:3.0:1787383562.402134:0:3649:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995584 offset 0 length 224: 4 00010000:00010000:3.0:1787383562.907962:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383563.931148:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383564.188805:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383549/real 1787383549] req@ffff963503e90000 x1874206984994560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787383564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383564.188834:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e90000 x1874206984994560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787383564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383564.188988:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383564.189006:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787383564.189011:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984994560:0@lo:38:kworker.0 00000100:00080000:3.0:1787383564.189041:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383564.189046:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383564.189049:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383564.189052:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787383564.189055:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383564.189060:0:13975:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 582 00000100:00080000:3.0:1787383564.189065:0:13975:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787383564.189071:0:13975:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963503eeb000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383564.189099:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca53100 x1874206984995712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383564.189161:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984995840:0@lo:400:kworker.0 00000400:00000100:3.0:1787383564.189207:0:3647:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995840 offset 0 length 224: 4 00000100:00100000:3.0:1787383564.190062:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984995712:0@lo:38:kworker.0 00000400:00000100:3.0:1787383564.190088:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995712 offset 0 length 520: 4 00010000:00010000:0.0:1787383564.956387:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787383565.274809:0:21273:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787383565.308175:0:21273:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787383565.308291:0:21273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383565.308335:0:21273:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383565.308342:0:21273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383565.308348:0:21273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383565.308374:0:21273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787383565.308379:0:21273:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787383565.308408:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383565.308420:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca53100 x1874206984995712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383584 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.308447:0:21273:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383565.308454:0:21273:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787383565.308460:0:21273:0:(import.c:65:import_set_state_nolock()) ffff963503eeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787383565.308465:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787383565.308469:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca53100 x1874206984995712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787383584 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.308476:0:21273:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383565.308478:0:21273:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1787383565.308559:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206984995712:0@lo:38:kworker.0 00000100:00080000:0.0:1787383565.309719:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383565.309732:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503e91180 x1874206984994688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.309978:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363d130000 x1874206984994944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.310060:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca52680 x1874206984995200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383570 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.310074:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff963503e91f80 x1874206984995456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383573 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.310082:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca53b80 x1874206984995584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383578 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.310089:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca50380 x1874206984995840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383580 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383565.310097:0:21273:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787383565.310102:0:21273:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787383565.310125:0:21273:0:(import.c:65:import_set_state_nolock()) ffff9635035f9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1787383565.310295:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383565.310313:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383565.310323:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383565.310328:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383565.310338:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383565.310346:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383565.310351:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787383565.310354:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787383565.310357:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787383565.310370:0:18626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:3.0:1787383565.310374:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383565.310380:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f17800/0xc40acec91532f8bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f8c2 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383565.310393:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383565.310395:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383565.310397:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383565.310421:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206984995200:0@lo:400:kworker.0 00000100:00100000:0.0:1787383565.313711:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984995968:0@lo:39:umount.0 00000400:00000100:0.0:1787383565.313799:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874206984995968 offset 0 length 224: 4 00000100:00100000:2.0:1787383565.313995:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984994944:0@lo:400:kworker.0 00000100:00100000:2.0:1787383565.314015:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1874206984995840:0@lo:400:kworker.0 00000100:00100000:1.0:1787383565.314109:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984994688:0@lo:400:kworker.0 00000100:00100000:1.0:1787383565.314124:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984995584:0@lo:400:kworker.0 00000100:00100000:1.0:1787383565.314132:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206984995456:0@lo:400:kworker.0 00010000:00010000:3.0:1787383565.979667:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383567.005639:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383568.027386:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383569.053132:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787383569.563226:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383569.563243:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787383570.079899:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383571.099043:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383572.125062:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383572.506919:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383557/real 1787383557] req@ffff963503e90a80 x1874206984995328/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383572 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383572.506967:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e90a80 x1874206984995328/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787383572 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383572.506993:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383572.507029:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787383572.507034:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984995328:0@lo:250:kworker.0 00000100:00080000:3.0:1787383572.507153:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787383572.507159:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787383572.507163:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383572.507169:0:13975:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 590 00000100:00080000:3.0:1787383572.507176:0:13975:0:(import.c:589:import_select_connection()) MGC192.168.203.102@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787383572.507185:0:13975:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff96363d9cf800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383572.507232:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca52680 x1874206984996096/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383572.507374:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984996096:0@lo:250:kworker.0 00000400:00000100:1.0:1787383572.507441:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874206984996096 offset 0 length 520: 4 00010000:00010000:0.0:1787383573.147579:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383574.172879:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383575.195071:0:17082:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383575.579085:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383565/real 1787383565] req@ffff963503e93100 x1874206984995968/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383575.579133:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e93100 x1874206984995968/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787383575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383575.579153:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9635035f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787383575.579177:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206984995968:0@lo:39:umount.0 00000100:00080000:0.0:1787383575.579279:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383575.579284:0:21273:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787383575.579289:0:21273:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787383575.580356:0:21273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580371:0:21273:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580378:0:21273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580461:0:21273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580490:0:21273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383575.580498:0:21273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580505:0:21273:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580510:0:21273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580516:0:21273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383575.580534:0:21273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787383575.580594:0:21273:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787383575.580621:0:21273:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787383575.580625:0:21273:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787383575.580631:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383575.580636:0:21273:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383575.580641:0:21273:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff963504594d40) has no exports 00000020:00080000:0.0:1787383575.580666:0:21273:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff963504594d40) has no exports 00010000:00010000:2.0:1787383575.580974:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383575.580982:0:17083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383575.580991:0:17083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96360516c200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383575.580995:0:17083:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383575.581004:0:17083:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383575.581011:0:17083:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383575.581017:0:17083:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787383575.581019:0:17083:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787383575.581022:0:17083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787383575.581023:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383575.581029:0:18626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383575.581035:0:18626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0400 already unused, calling callback (ffffffffc129ec20) 00010000:00010000:2.0:1787383575.581035:0:17083:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 10000000:00010000:3.0:1787383575.581038:0:18626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383575.581039:0:17083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383575.581046:0:18626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383575.581046:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96360516c200/0xc40acec91532f891 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f898 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383575.581053:0:18626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383575.581070:0:18626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787383575.581070:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383575.581072:0:18626:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787383575.581072:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383575.581074:0:18626:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787383575.581074:0:17083:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383575.581080:0:18626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:3.0:1787383575.581083:0:18626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383575.581089:0:18626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0400/0xc40acec91532fb3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532fb46 expref: -99 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383575.581113:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383575.581115:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383575.581117:0:18626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787383575.588200:0:21273:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635030837e0 - data ffff9636193e7288/ffff9636369bdc00 00000020:01000000:0.0:1787383575.588333:0:21273:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9635030836c0 - data ffff963629152798/ffff96350242b800 00100000:10000000:1.0:1787383575.611079:0:21273:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787383575.620943:0:21273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f8a6 00000020:00000080:3.0:1787383575.620956:0:21273:0:(genops.c:906:class_export_put()) final put ffff963608498000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787383575.620977:0:21273:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963620417000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787383575.620981:0:21273:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620417000 2 00000020:01000004:3.0:1787383575.620984:0:21273:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff963620417000 from lustre-OST0001 00000020:00000080:3.0:1787383575.621007:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383575.621016:0:21273:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787383575.621019:0:21273:0:(genops.c:906:class_export_put()) final put ffff963622d87000/lustre-OST0001_UUID 00000020:00000080:3.0:1787383575.621022:0:21273:0:(genops.c:865:class_export_destroy()) destroying export ffff963622d87000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787383575.621029:0:21273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1787383575.621118:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963608498000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1787383575.621146:0:21273:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 98408fb2-7fed-492b-911f-46eabbf1f8e3->MGS 00010000:00010000:3.0:1787383575.621162:0:21273:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383575.621174:0:21273:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383575.621192:0:21273:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787383575.621195:0:21273:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787383575.621198:0:21273:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787383575.621212:0:21273:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:3.0:1787383575.621216:0:21273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c8600/0xc40acec91532f6b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f6bc expref: -99 pid: 17826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383575.621240:0:21273:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383575.621247:0:21273:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383575.621251:0:21273:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787383575.621254:0:21273:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787383575.621255:0:21273:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787383575.621264:0:21273:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff96363d9cf800 00010000:00010000:3.0:1787383575.621268:0:21273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff963610f16a00/0xc40acec91532f5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc40acec91532f5ab expref: -99 pid: 17073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787383575.621282:0:21273:0:(import.c:65:import_set_state_nolock()) ffff96363d9cf800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787383575.621286:0:21273:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787383575.621288:0:21273:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787383575.621290:0:21273:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787383575.621294:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787383575.621305:0:21273:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff96363ca52680 x1874206984996096/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787383592 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787383575.621330:0:21273:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787383575.621333:0:21273:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1787383575.621900:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:98408fb2-7fed-492b-911f-46eabbf1f8e3:3646:1874206984996096:0@lo:250:kworker.0 10000000:01000000:3.0:1787383575.622048:0:21273:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787383575.622062:0:21273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f58f 00000020:00000080:3.0:1787383575.622068:0:21273:0:(genops.c:906:class_export_put()) final put ffff96362d8a8800/98408fb2-7fed-492b-911f-46eabbf1f8e3 00000020:01000000:3.0:1787383575.622083:0:21273:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.102@tcp (flags='') 00000020:00000080:3.0:1787383575.622088:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383575.622093:0:21273:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.102@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787383575.622097:0:21273:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9636352cb380) has no exports 10000000:01000000:3.0:1787383575.622113:0:17091:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787383575.622159:0:21273:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.102@tcp: client import never connected 00000100:00080000:3.0:1787383575.622162:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787383575.622164:0:21273:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787383575.622166:0:21273:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787383575.622168:0:21273:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787383575.622197:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787383575.622202:0:21273:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.102@tcp (uuid 98408fb2-7fed-492b-911f-46eabbf1f8e3) 00000020:01000000:3.0:1787383575.622207:0:21273:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787383575.622222:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787383575.622226:0:21273:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787383575.622230:0:21273:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff963503eeb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787383575.622244:0:21273:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9636351b0000) has exports, disconnecting them 00000020:00080000:3.0:1787383575.622248:0:21273:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff963503eeb800), last request at 1787383497 00000020:00000080:3.0:1787383575.622252:0:21273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f8d0 00000020:00080000:3.0:1787383575.622262:0:21273:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff963503eeb800): rc 0 00000020:00000080:3.0:1787383575.622266:0:21273:0:(genops.c:906:class_export_put()) final put ffff963503eeb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787383575.622559:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96362d8a8800/98408fb2-7fed-492b-911f-46eabbf1f8e3 for MGC192.168.203.102@tcp 00000020:00000080:2.0:1787383575.622572:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff96363d9cf800 for MGC192.168.203.102@tcp 00000020:00000080:2.0:1787383575.622579:0:8:0:(genops.c:906:class_export_put()) final put ffff96363d9cc800/98408fb2-7fed-492b-911f-46eabbf1f8e3 00000020:00000080:2.0:1787383575.622594:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff96363d9cc800/98408fb2-7fed-492b-911f-46eabbf1f8e3 for MGC192.168.203.102@tcp 00000020:01000000:2.0:1787383575.622605:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.102@tcp (98408fb2-7fed-492b-911f-46eabbf1f8e3) 00000020:00000080:2.0:1787383575.622861:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503eeb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787383575.626273:0:21273:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787383575.626282:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787383575.626286:0:21273:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787383575.626294:0:21273:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787383575.626448:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787383575.626458:0:21273:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787383575.626465:0:21273:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787383575.626470:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787383575.626474:0:21273:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787383575.626493:0:21273:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9635035f9000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787383575.626499:0:21273:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9636351b19c0) has exports, disconnecting them 00000020:00080000:2.0:1787383575.626504:0:21273:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9635035f9000), last request at 1787383497 00000020:00000080:2.0:1787383575.626509:0:21273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f8de 00000020:00080000:2.0:1787383575.626525:0:21273:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9635035f9000): rc 0 00000020:00000080:2.0:1787383575.626530:0:21273:0:(genops.c:906:class_export_put()) final put ffff9635035f9000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1787383575.627420:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff963503eeb000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1787383575.627431:0:8:0:(genops.c:906:class_export_put()) final put ffff963503eec800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787383575.627435:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503eec800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787383575.627441:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787383575.627502:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9635035f9000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1787383575.630883:0:21273:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787383575.630891:0:21273:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787383575.630895:0:21273:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787383575.630902:0:21273:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787383575.630986:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9635035f9800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787383575.631045:0:17082:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787383575.631158:0:17083:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1787383575.631215:0:18626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787383575.631363:0:17077:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff96363d8ad000:17077] 0 exiting: rc = 1 00000100:00100000:0.0:1787383575.631439:0:17078:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff963503118000:17078] 1 exiting: rc = 0 00000100:00100000:0.0:1787383575.631496:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.631718:0:17081:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff96363d8ac200:17081] 2 exiting: rc = 0 00000100:00100000:0.0:1787383575.631783:0:17080:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff96363d8ad400:17080] 1 exiting: rc = 0 00000100:00100000:0.0:1787383575.631836:0:20582:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9635023d9c00:20582] 3 exiting: rc = 0 00000100:00100000:0.0:1787383575.631893:0:17079:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff96363d8acc00:17079] 0 exiting: rc = 1 00000100:00100000:0.0:1787383575.631962:0:20870:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff963601343200:20870] 4 exiting: rc = 0 00000100:00100000:0.0:1787383575.632017:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632026:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632033:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632039:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632044:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632053:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632059:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632064:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632080:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632086:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632091:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632096:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632101:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632105:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632110:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632114:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632119:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632127:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632135:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632142:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632147:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632152:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632157:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632166:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632172:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632177:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632182:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632187:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632193:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632198:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632203:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632207:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632212:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632217:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632222:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632227:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632243:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632249:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632257:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632263:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632267:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632275:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632280:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632292:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632296:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632302:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632307:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632312:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632322:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632328:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632334:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632339:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632343:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632348:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632353:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632357:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632362:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632367:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632371:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632376:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632381:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632386:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632391:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.632397:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787383575.632990:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383575.633007:0:21273:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1787383575.633015:0:21273:0:(genops.c:906:class_export_put()) final put ffff963503ee9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1787383575.633019:0:21273:0:(genops.c:865:class_export_destroy()) destroying export ffff963503ee9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1787383575.633025:0:21273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1787383575.633075:0:21273:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963620417000 1 00000020:00000080:0.0:1787383575.633081:0:21273:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xc40acec91532f88a 00000020:00000080:0.0:1787383575.633087:0:21273:0:(genops.c:906:class_export_put()) final put ffff963503f50800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787383575.633097:0:21273:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787383575.633106:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff963503f50800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787383575.633122:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383575.633132:0:21273:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383575.633146:0:21273:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9636351b4d40) has no exports 00000020:00000080:0.0:1787383575.723496:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383575.723511:0:21273:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787383575.723517:0:21273:0:(genops.c:906:class_export_put()) final put ffff963620416000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787383575.723522:0:21273:0:(genops.c:865:class_export_destroy()) destroying export ffff963620416000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787383575.723533:0:21273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787383575.729378:0:21273:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff963620414800 00000020:01000000:0.0:1787383575.729409:0:21273:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787383575.729416:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787383575.729422:0:21273:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787383575.729426:0:21273:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9636352c99c0) has no exports 00000020:00000080:0.0:1787383575.729452:0:21273:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787383575.729462:0:21273:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787383575.729467:0:21273:0:(genops.c:906:class_export_put()) final put ffff963640944800/OSS_uuid 00000020:00000080:0.0:1787383575.729470:0:21273:0:(genops.c:865:class_export_destroy()) destroying export ffff963640944800/OSS_uuid for OSS 00000020:01000000:0.0:1787383575.729475:0:21273:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787383575.729626:0:17090:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787383575.729826:0:19676:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff96350304ac00:19676] 4 exiting: rc = 0 00000100:00100000:2.0:1787383575.729949:0:18599:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff96363ccc3c00:18599] 0 exiting: rc = 1 00000100:00100000:2.0:1787383575.730017:0:18602:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff96350204dc00:18602] 2 exiting: rc = 0 00000100:00100000:2.0:1787383575.730348:0:19237:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff96363154bc00:19237] 3 exiting: rc = 0 00000100:00100000:2.0:1787383575.730466:0:18600:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff963635279200:18600] 1 exiting: rc = 0 00000100:00100000:0.0:1787383575.730534:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730561:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730570:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730575:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730582:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730587:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730592:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730597:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730603:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730608:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730613:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730618:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730623:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730628:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730633:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730647:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730652:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730657:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730673:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730678:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730683:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730688:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730693:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730698:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730703:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730708:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730713:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730718:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730723:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730727:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730731:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730736:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730740:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730744:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730749:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730754:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730758:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730763:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730787:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730791:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730796:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730800:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730805:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730810:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730815:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730819:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730824:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730829:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730833:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730838:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730843:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730848:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730868:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730878:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730883:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730887:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730892:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730897:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730902:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.730907:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.731064:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.731070:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.731075:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.731081:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732008:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff963602dbfa00:18603] 0 exiting: rc = 1 00000100:00100000:3.0:1787383575.732342:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff963607f11a00:18604] 1 exiting: rc = 0 00000100:00100000:3.0:1787383575.732396:0:19888:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff96350267a400:19888] 2 exiting: rc = 0 00000100:00100000:0.0:1787383575.732621:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732629:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732690:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732698:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732703:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732708:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732714:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732719:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732723:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732728:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732733:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732737:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732742:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732748:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732753:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732758:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732763:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732788:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732793:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732798:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732804:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732809:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732814:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732831:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732836:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732841:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732846:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732851:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732855:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732861:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732866:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732871:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732876:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732882:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732887:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732892:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732897:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732902:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.732994:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733002:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733008:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733013:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733018:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733023:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733028:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733033:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733037:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733043:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733048:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733054:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733058:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733063:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733068:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733073:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733078:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733082:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733087:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733092:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733105:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733110:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733115:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733120:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733125:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.733130:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787383575.734201:0:20236:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9636368c5400:20236] 3 exiting: rc = 0 00000100:00100000:0.0:1787383575.734413:0:18607:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff963502331400:18607] 2 exiting: rc = 0 00000100:00100000:3.0:1787383575.734802:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff963502331800:18606] 1 exiting: rc = 0 00000100:00100000:0.0:1787383575.736032:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff963602dbf600:18605] 0 exiting: rc = 1 00000100:00100000:3.0:1787383575.736207:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736227:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736245:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736263:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736270:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736276:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736282:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736294:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736308:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736317:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736323:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736329:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736338:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736344:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736378:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736386:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736392:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736397:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736403:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736409:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736415:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736425:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736431:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736436:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736442:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736448:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736454:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736459:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736465:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736471:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736477:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736482:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736488:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736494:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736500:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736506:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736512:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736518:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736549:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736555:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736561:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736568:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736574:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736580:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736586:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736592:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736598:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736609:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736615:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736625:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736877:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736888:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736898:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736905:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736911:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736917:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736922:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736927:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736933:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736939:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736944:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736951:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736957:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.736972:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787383575.756448:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff963502331000:18608] 0 exiting: rc = 1 00000100:00100000:2.0:1787383575.756556:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff963502330a00:18609] 1 exiting: rc = 0 00000100:00100000:3.0:1787383575.756646:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756654:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756659:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756664:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756699:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756704:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756709:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756714:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756723:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756741:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756747:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756754:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756759:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756780:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756787:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756793:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756798:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756804:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756809:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756814:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756819:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756825:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756830:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756834:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756839:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756844:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756850:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756855:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756859:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756865:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756916:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756924:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756930:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756934:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756939:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756953:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756974:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756980:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756985:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756990:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.756994:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757000:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757005:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757010:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757023:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757028:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757033:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757039:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757044:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757049:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757054:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757059:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757064:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757070:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757074:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757080:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757085:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757089:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757095:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757100:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757105:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757110:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757121:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.757128:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787383575.761838:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff963631337c00:18610] 0 exiting: rc = 1 00000100:00100000:1.0:1787383575.772116:0:18611:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff96350260b800:18611] 1 exiting: rc = 0 00000100:00100000:3.0:1787383575.772363:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772371:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772384:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772446:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772452:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772457:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772463:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772486:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772493:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772499:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772505:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772511:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772567:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772574:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772579:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772594:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772599:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772659:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772665:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772683:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772689:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772695:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772700:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772705:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772710:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772715:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772721:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772726:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772732:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772737:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772742:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772760:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772796:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772803:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772809:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772815:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772820:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772825:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772830:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772836:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772842:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772849:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772855:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772875:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772881:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772886:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772892:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772899:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772905:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772911:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772924:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772929:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772936:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.772941:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773664:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773689:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773695:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773700:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773706:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773712:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773719:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773725:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773731:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787383575.773744:0:21273:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787383575.789583:0:21273:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787383596.164315:0:22039:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787383606.228527:0:22638:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787383606.228533:0:22638:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787383606.228535:0:22638:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787383606.228644:0:22638:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9635035fe000 00000020:01000004:0.0:1787383606.228660:0:22638:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787383606.228667:0:22638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787383606.228681:0:22638:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9636351b4d40) 00000020:00000080:0.0:1787383606.228693:0:22638:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787383606.341557:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787383606.350401:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787383606.366893:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787383606.368354:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787383606.368835:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787383606.369223:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787383606.369464:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1787383606.369853:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.371215:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.373454:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.374369:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.374634:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.374923:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.375173:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.375537:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.375921:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.379235:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.382354:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.383073:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.383491:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.387305:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.387815:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.388113:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.388521:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.388811:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.389087:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.389426:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.389719:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.390193:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.390487:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.390790:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.391165:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.391636:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787383606.391947:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787383606.395031:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787383606.397015:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787383606.397298:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787383606.401215:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.402033:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.402267:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787383606.402642:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787383606.402934:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787383606.403196:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.403565:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.403878:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.404097:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787383606.404338:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787383606.404860:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.405235:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.406101:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1787383606.406811:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1787383606.407136:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1787383606.407432:0:22638:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1787383606.411111:0:22638:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787383606.411320:0:22638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787383606.411328:0:22638:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787383606.411339:0:22638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fdfb 00000020:01000004:1.0:1787383606.411345:0:22638:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1787383606.411350:0:22638:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787383606.411354:0:22638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9635035fe000 from MGS 00000020:01000004:1.0:1787383606.411358:0:22638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787383606.411367:0:22638:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9636352c8000) 00000020:00000080:1.0:1787383606.411376:0:22638:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787383606.411432:0:22638:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9635035fe000 from MGS, refs=2 00080000:01000000:1.0:1787383606.411437:0:22638:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383606.411441:0:22638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fe09 00000100:00100000:1.0:1787383606.411544:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787383606.412115:0:22638:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787383606.412123:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787383606.413227:0:22638:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787383606.413238:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787383606.413931:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787383606.414199:0:22638:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787383606.414204:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787383606.424702:0:22638:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787383606.424715:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787383606.425268:0:22638:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787383606.425283:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787383606.433691:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383606.433698:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383606.433701:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383606.434197:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383606.434199:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383606.434201:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383606.434742:0:22638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787383606.438139:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787383606.458007:0:22638:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787383606.459071:0:22650:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787383606.459126:0:22638:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787383606.459167:0:22638:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787383606.470171:0:22638:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787383606.470480:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383606.470721:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787383606.470728:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787383606.472045:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787383606.472054:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787383606.472475:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787383606.472481:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787383606.475752:0:22655:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787383606.475881:0:22638:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787383606.475903:0:22638:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.102@tcp' 00000020:01000004:1.0:1787383606.475905:0:22638:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787383606.475933:0:22638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.102@tcp (typ=mgc) 00000020:00000080:1.0:1787383606.475945:0:22638:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.102@tcp (ffff9636352c99c0) 00000020:00000080:1.0:1787383606.476144:0:22638:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787383606.476220:0:22638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963604a27800@MGC192.168.203.102@tcp: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383606.476381:0:22638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.102@tcp-0 is initialized 00000040:01000000:1.0:1787383606.476386:0:22638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787383606.477414:0:22656:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787383606.477541:0:22638:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.102@tcp (uuid 48c79c93-7083-4972-b8c3-d0fe8d8c1db6) 00000020:00000080:0.0:1787383606.477559:0:22638:0:(genops.c:1406:class_connect()) connect: client 48c79c93-7083-4972-b8c3-d0fe8d8c1db6, cookie 0xc40acec91532fe17 00000100:00080000:0.0:1787383606.477569:0:22638:0:(import.c:510:import_select_connection()) MGC192.168.203.102@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383606.477574:0:22638:0:(import.c:624:import_select_connection()) MGC192.168.203.102@tcp: import ffff963604a27800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383606.477606:0:22638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e92d80 x1874206984996224/t0(0) o250->MGC192.168.203.102@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383606.477636:0:22638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 48c79c93-7083-4972-b8c3-d0fe8d8c1db6->MGS 00000020:01000004:0.0:1787383606.477659:0:22638:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787383606.477663:0:22638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787383606.477676:0:22638:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9636351b19c0) 00000020:00000080:0.0:1787383606.477686:0:22638:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787383606.477740:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3646:1874206984996224:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787383606.477818:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383606.478061:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996224 00000100:00100000:1.0:1787383606.478070:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996224 00000100:00100000:1.0:1787383606.478103:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383606.478110:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1874206984996224:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787383606.478134:0:22652:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 48c79c93-7083-4972-b8c3-d0fe8d8c1db6@0@lo t0 exp 0000000000000000 cur 639 last 0 00000020:00000080:1.0:1787383606.478156:0:22652:0:(genops.c:1406:class_connect()) connect: client 48c79c93-7083-4972-b8c3-d0fe8d8c1db6, cookie 0xc40acec91532fe25 00000100:00080000:1.0:1787383606.478352:0:22652:0:(import.c:65:import_set_state_nolock()) ffff963604a26000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383606.478408:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:3646:x1874206984996224:12345-0@lo:250:mount.lustre.0 Request processed in 296us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383606.478417:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383606.478462:0:3646:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.102@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787383606.478469:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.102@tcp: connect to target with instance 0 00000100:00080000:1.0:1787383606.478484:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.102@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787383606.478489:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787383606.478493:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963604a27800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787383606.478496:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787383606.478504:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787383606.478510:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3646:1874206984996224:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787383606.488943:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383606.489122:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383606.489129:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787383606.496681:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787383606.496696:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787383606.497353:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787383606.497361:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787383606.501931:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383606.502098:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787383606.502104:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787383606.504315:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787383606.504326:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787383606.559266:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383606.559442:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787383606.559449:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787383606.561196:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787383606.561208:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787383606.562291:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383606.562436:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787383606.562448:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787383606.563426:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787383606.563435:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787383606.565177:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383606.565346:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787383606.565352:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787383606.566298:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383606.566306:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787383606.567146:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383606.567296:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787383606.567301:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787383606.568260:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787383606.568270:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787383606.590752:0:22638:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383606.591271:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787383606.591279:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787383606.593274:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787383606.593287:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787383606.594495:0:22638:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787383606.594506:0:22638:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787383606.595735:0:22638:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787383606.596077:0:22638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787383606.596084:0:22638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787383606.596384:0:22638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787383606.596422:0:22638:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787383606.596427:0:22638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787383606.596428:0:22638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383606.596430:0:22638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383606.596431:0:22638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383606.596432:0:22638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383606.596433:0:22638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383606.596435:0:22638:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383606.596436:0:22638:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383606.596437:0:22638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383606.596439:0:22638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383606.596441:0:22638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787383606.596443:0:22638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383606.596444:0:22638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383606.596445:0:22638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383606.596446:0:22638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383606.596447:0:22638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383606.596448:0:22638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383606.596450:0:22638:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383606.596451:0:22638:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383606.596452:0:22638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383606.596453:0:22638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383606.596476:0:22638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787383606.596495:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787383606.596625:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383606.596705:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.597131:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996352 00000100:00100000:3.0:1787383606.597139:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996352 00000100:00100000:3.0:1787383606.597219:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383606.597228:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:22638:x1874206984996352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787383606.597273:0:22654:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787383606.597275:0:22654:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787383606.597278:0:22654:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787383606.597734:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787383606.598382:0:22654:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787383606.600381:0:22676:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787383606.600389:0:22676:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787383606.600393:0:22676:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787383606.600396:0:22676:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787383606.600557:0:22676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787383606.601140:0:22654:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787383606.601151:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787383606.602970:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:22638:x1874206984996352:12345-0@lo:253:mount.lustre.0 Request processed in 5729us (6394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.602984:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383606.603115:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787383606.603131:0:22638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787383606.603135:0:22638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383606.603137:0:22638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383606.603139:0:22638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383606.603140:0:22638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383606.603142:0:22638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383606.603143:0:22638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383606.603145:0:22638:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383606.603146:0:22638:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383606.603148:0:22638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383606.603149:0:22638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787383606.603167:0:22638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9635035fe000 from lustre-MDT0000 10000000:01000000:1.0:1787383606.603195:0:22638:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787383606.603198:0:22638:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787383606.603203:0:22638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9636352c99c0 10000000:01000000:1.0:1787383606.603207:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383606.603215:0:22638:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9636352c99c0 from 1 10000000:01000000:1.0:1787383606.603218:0:22638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787383606.603254:0:22638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.603264:0:22638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.603273:0:22638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383606.603307:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383606.603342:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383606.603377:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.603440:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996480 00000100:00100000:2.0:1787383606.603447:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996480 00000100:00100000:2.0:1787383606.603485:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787383606.603493:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:22638:x1874206984996480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383606.603505:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383606.603518:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8c00/0xc40acec91532fe33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fe2c expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.603537:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8c00/0xc40acec91532fe33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fe2c expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.603558:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8c00/0xc40acec91532fe33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fe2c expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.603579:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8c00, rc 0) 00000100:00100000:2.0:1787383606.603621:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+6:22638:x1874206984996480:12345-0@lo:101:mount.lustre.0 Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.603627:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383606.603692:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383606.603705:0:22638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.603714:0:22638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.603780:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.603809:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.603831:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.603855:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996608 00000100:00100000:3.0:1787383606.603859:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996608 00000100:00100000:3.0:1787383606.603889:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383606.603896:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+6:22638:x1874206984996608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383606.603968:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+6:22638:x1874206984996608:12345-0@lo:501:mount.lustre.0 Request processed in 72us (158us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787383606.603975:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383606.604168:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996608:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787383606.604195:0:22638:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787383606.604211:0:22638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.604219:0:22638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383606.604226:0:22638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9635035fe000 10000000:01000000:0.0:1787383606.604230:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787383606.604234:0:22638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9635035fe000 10000000:01000000:0.0:1787383606.604236:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787383606.604239:0:22638:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9635035fe000 from 1 10000000:01000000:0.0:1787383606.604241:0:22638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787383606.604257:0:22638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.604275:0:22638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.604282:0:22638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.604293:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383606.604317:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.604343:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.604367:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996736 00000100:00100000:3.0:1787383606.604971:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996736 00000100:00100000:3.0:1787383606.605123:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383606.605140:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+6:22638:x1874206984996736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383606.605152:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383606.605167:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1200/0xc40acec91532fe41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fe3a expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383606.605186:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1200/0xc40acec91532fe41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fe3a expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383606.605195:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1200/0xc40acec91532fe41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fe3a expref: 7 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383606.605204:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1200, rc 0) 00000100:00100000:3.0:1787383606.605246:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+7:22638:x1874206984996736:12345-0@lo:101:mount.lustre.0 Request processed in 107us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.605252:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787383606.605332:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383606.605347:0:22638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe41 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.605354:0:22638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fe41 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383606.605368:0:22638:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787383606.605383:0:22638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe41 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.605391:0:22638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac9000/0xc40acec91532fe3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe41 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383606.605398:0:22638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787383606.605402:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383606.605406:0:22638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9635035fe000 10000000:01000000:0.0:1787383606.605408:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787383606.605417:0:22638:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787383606.605419:0:22638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787383606.605437:0:22638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.605444:0:22638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.605452:0:22638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.605465:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383606.605491:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.605794:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.605843:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996864 00000100:00100000:2.0:1787383606.605847:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996864 00000100:00100000:2.0:1787383606.605881:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383606.605888:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+7:22638:x1874206984996864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383606.605895:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383606.605904:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8e00/0xc40acec91532fe4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fe48 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.605918:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8e00/0xc40acec91532fe4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fe48 expref: 8 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.605927:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8e00/0xc40acec91532fe4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fe48 expref: 8 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.605934:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8e00, rc 0) 00000100:00100000:2.0:1787383606.605977:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+8:22638:x1874206984996864:12345-0@lo:101:mount.lustre.0 Request processed in 89us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.605983:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383606.606281:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383606.606294:0:22638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe4f expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.606302:0:22638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fe4f expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.606357:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.606381:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.606406:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.606443:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984996992 00000100:00100000:2.0:1787383606.606447:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984996992 00000100:00100000:2.0:1787383606.606484:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787383606.606490:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+8:22638:x1874206984996992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383606.606809:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22638:x1874206984996992:12345-0@lo:501:mount.lustre.0 Request processed in 318us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.606816:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787383606.606924:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984996992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.606952:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984997120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383606.606998:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.607039:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383606.607136:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984997120 00000100:00100000:1.0:1787383606.607140:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984997120 00000100:00100000:1.0:1787383606.607175:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383606.607182:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22638:x1874206984997120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383606.607865:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22638:x1874206984997120:12345-0@lo:503:mount.lustre.0 Request processed in 681us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383606.607873:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383606.607957:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984997120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383606.611273:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22677:1874206984997248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383606.611341:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.611382:0:22677:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503d11180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383606.611432:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984997248 00000100:00100000:1.0:1787383606.611439:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984997248 00000100:00100000:1.0:1787383606.611480:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383606.611489:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22677:x1874206984997248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383606.612395:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22677:x1874206984997248:12345-0@lo:502:llog_process_th.0 Request processed in 903us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383606.612406:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383606.612482:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22677:1874206984997248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383606.612512:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.612523:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.612526:0:22677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787383606.612531:0:22677:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787383606.612534:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383606.612550:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9636351b0000) 00000020:00000080:0.0:1787383606.612637:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787383606.612645:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787383606.612733:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787383606.612740:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fe5d 00000020:00000080:0.0:1787383606.616639:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787383606.616652:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.616660:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.616663:0:22677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787383606.616666:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.616672:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.616673:0:22677:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787383606.616678:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383606.616692:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9636351b3380) 00000020:00000080:0.0:1787383606.616714:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787383606.616719:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787383606.616721:0:22677:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787383606.616724:0:22677:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787383606.616731:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787383606.617061:0:22677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9635035fe000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787383606.617075:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff96350273b380) 00000020:00000080:0.0:1787383606.617083:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787383606.617130:0:22677:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787383606.617136:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532fe72 00000020:00000080:0.0:1787383606.617247:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787383606.617253:0:22677:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787383606.617258:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc40acec91532fe79 00080000:01000000:0.0:1787383606.617263:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787383606.617266:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fe80 00010000:00010000:3.0:1787383606.678514:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787383606.679247:0:22677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1787383606.679672:0:22677:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787383606.680193:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff96363cd53380) 00000020:00000080:3.0:1787383606.680210:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787383606.680283:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787383606.680291:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fe8e 00000020:00000080:0.0:1787383606.682289:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787383606.685887:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc40acec91532fe95 00000020:00000080:1.0:1787383606.687856:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787383606.687869:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383606.687876:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.687879:0:22677:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787383606.687882:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383606.687885:0:22677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787383606.687886:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383606.687888:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383606.687889:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383606.687891:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.687898:0:22677:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383606.687902:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383606.687906:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.687908:0:22677:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787383606.687912:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787383606.687968:0:22677:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787383606.687991:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383606.687994:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.687995:0:22677:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787383606.687998:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383606.688001:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.688003:0:22677:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787383606.688006:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383606.688011:0:22677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:1.0:1787383606.688226:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383606.688241:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9636352cb380) 00000020:00000080:1.0:1787383606.688260:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787383606.688265:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383606.688334:0:22677:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787383606.688339:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787383606.688348:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fea3 00010000:00080000:1.0:1787383606.688377:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363cd5b800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383606.692461:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787383606.693861:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383606.693873:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787383606.693903:0:22677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787383606.693920:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532feaa 00000100:00080000:1.0:1787383606.693930:0:22677:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383606.693935:0:22677:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363cd5b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383606.693966:0:22677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363692a300 x1874206984997376/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383606.694007:0:22677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787383606.694071:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383606.694075:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.694077:0:22677:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787383606.694080:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383606.694083:0:22677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787383606.694084:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383606.694086:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383606.694087:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383606.694089:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.694091:0:22677:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383606.694093:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383606.694098:0:22677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787383606.694101:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.694102:0:22677:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787383606.694105:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383606.694108:0:22677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:1.0:1787383606.694128:0:22677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787383606.694130:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383606.694141:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9636352ccd40) 00000020:00000080:1.0:1787383606.694153:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787383606.694156:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383606.694216:0:22677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787383606.694221:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787383606.694226:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532feb8 00010000:00080000:1.0:1787383606.694258:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96361122b800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383606.694415:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1787383606.694947:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984997376:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383606.695122:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.695380:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984997376 00000100:00100000:0.0:1787383606.695387:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984997376 00000040:01000000:1.0:1787383606.695408:0:22677:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787383606.695424:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383606.695431:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984997376:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1787383606.695449:0:22664:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787383606.695633:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787383606.698147:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383606.698370:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787383606.703214:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787383606.707000:0:22683:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787383606.707010:0:22683:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787383606.707822:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787383606.707834:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787383606.707870:0:22677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787383606.707889:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532febf 00000100:00080000:1.0:1787383606.707898:0:22677:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383606.707904:0:22677:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96361122b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383606.707938:0:22677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363692a680 x1874206984997504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383606.707967:0:22677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787383606.708073:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383606.708078:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.708080:0:22677:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787383606.708083:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383606.708086:0:22677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1787383606.708087:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383606.708089:0:22677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383606.708090:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383606.708092:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.708094:0:22677:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383606.708096:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383606.708100:0:22677:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787383606.708103:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383606.708105:0:22677:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787383606.708108:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383606.708112:0:22677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:1.0:1787383606.708133:0:22677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787383606.708136:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383606.708147:0:22677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9635033c0000) 00000020:00000080:1.0:1787383606.708158:0:22677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787383606.708163:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383606.708225:0:22677:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787383606.708231:0:22677:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787383606.708242:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc40acec91532fecd 00010000:00080000:1.0:1787383606.708271:0:22677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9636064d6800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383606.708471:0:22677:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787383606.708535:0:22677:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787383606.708549:0:22677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787383606.708639:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206984997376:12345-0@lo:38:llog_process_th.0 Request processed in 13206us (13516us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787383606.708651:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383606.709866:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984997504:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787383606.709913:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984997504 offset 0 length 520: 4 00000100:00080000:0.0:1787383606.709965:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383606.709970:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383606.709974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984997376:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787383606.710414:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383606.710835:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787383606.710947:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1787383606.712180:0:22685:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787383606.712186:0:22685:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787383606.714408:0:22677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787383606.714424:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383606.714485:0:22677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787383606.714522:0:22677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91532fed4 00000100:00080000:0.0:1787383606.714532:0:22677:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383606.714538:0:22677:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9636064d6800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383606.714573:0:22677:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e90700 x1874206984997632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383606.714599:0:22677:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787383606.714637:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984997632:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1787383606.714684:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:1.0:1787383606.714687:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206984997632 offset 0 length 520: 4 00000020:00000080:0.0:1787383606.714688:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.714690:0:22677:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787383606.714693:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.714696:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.714697:0:22677:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787383606.714700:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787383606.714701:0:22677:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787383606.714703:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.714716:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.714718:0:22677:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787383606.714721:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.714723:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.714724:0:22677:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787383606.714728:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787383606.714753:0:22677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22677:1874206984997760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383606.714823:0:22677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.714849:0:22677:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383606.714919:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984997760 00000100:00100000:1.0:1787383606.714927:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984997760 00000100:00100000:1.0:1787383606.714968:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383606.714976:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22677:x1874206984997760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787383606.715099:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22677:x1874206984997760:12345-0@lo:502:llog_process_th.0 Request processed in 122us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383606.715107:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383606.715373:0:22677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22677:1874206984997760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383606.715403:0:22677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.715408:0:22677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.715409:0:22677:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787383606.715413:0:22677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787383606.715499:0:22638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787383606.715520:0:22638:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787383606.715537:0:22638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe4f expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.715549:0:22638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac8000/0xc40acec91532fe48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe4f expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383606.715580:0:22638:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9635035fe000 from 1 10000000:01000000:1.0:1787383606.715582:0:22638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383606.715617:0:22638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.715624:0:22638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.715632:0:22638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383606.715644:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984997888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383606.715672:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383606.715699:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360396a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787383606.715802:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984997888 00000100:00100000:0.0:1787383606.715813:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984997888 00000100:00100000:0.0:1787383606.715846:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383606.715853:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963618030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+9:22638:x1874206984997888:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383606.715861:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383606.715874:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fedb expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.715893:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fedb expref: 10 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.715903:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fedb expref: 10 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.715911:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9e00, rc 0) 00000100:00100000:0.0:1787383606.715950:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963618030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+10:22638:x1874206984997888:12345-0@lo:101:mount.lustre.0 Request processed in 97us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383606.715956:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383606.716163:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984997888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383606.716185:0:22638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.716193:0:22638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383606.716751:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998016:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787383606.716813:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383606.716844:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360396a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.716854:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998016 00000100:00100000:3.0:1787383606.716859:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998016 00000100:00100000:3.0:1787383606.716893:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383606.716900:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963618031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+10:22638:x1874206984998016:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787383606.716914:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787383606.716926:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787383606.717001:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963618031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+10:22638:x1874206984998016:12345-0@lo:256:mount.lustre.0 Request processed in 100us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.717009:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383606.717133:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998016:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787383606.719275:0:22638:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383606.719306:0:22638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.719320:0:22638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383606.719329:0:22638:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9635035fe000 from 1 10000000:01000000:0.0:1787383606.719331:0:22638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383606.719371:0:22638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.719395:0:22638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.719405:0:22638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.719429:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383606.720342:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.720375:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383606.720685:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998144 00000100:00100000:1.0:1787383606.720693:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998144 00000100:00100000:1.0:1787383606.720746:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383606.720785:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+10:22638:x1874206984998144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383606.720801:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383606.720819:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fee9 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.720843:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fee9 expref: 11 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.720855:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fee9 expref: 11 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.720864:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a6400, rc 0) 00000100:00100000:1.0:1787383606.720924:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984998144:12345-0@lo:101:mount.lustre.0 Request processed in 160us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383606.720931:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383606.720981:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383606.720995:0:22638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.721004:0:22638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.721143:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.721173:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.723012:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.725160:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998272 00000100:00100000:2.0:1787383606.725174:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998272 00000100:00100000:2.0:1787383606.725226:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383606.725235:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984998272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383606.725404:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984998272:12345-0@lo:501:mount.lustre.0 Request processed in 169us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.725412:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383606.725934:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.725987:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383606.726605:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.726644:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610ee8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.726685:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998400 00000100:00100000:3.0:1787383606.726691:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998400 00000100:00100000:3.0:1787383606.726734:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383606.726742:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984998400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383606.726862:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984998400:12345-0@lo:503:mount.lustre.0 Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.726870:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383606.726905:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383606.727621:0:22687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22687:1874206984998528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383606.727668:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.727698:0:22687:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.728181:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998528 00000100:00100000:2.0:1787383606.728187:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998528 00000100:00100000:2.0:1787383606.728230:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383606.728239:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22687:x1874206984998528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.728874:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22687:x1874206984998528:12345-0@lo:502:llog_process_th.0 Request processed in 633us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.728883:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383606.728904:0:22687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22687:1874206984998528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383606.728932:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.728942:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.728944:0:22687:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383606.728950:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9635035fe000 00000020:00000080:0.0:1787383606.728953:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383606.728960:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.728963:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.728964:0:22687:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383606.728966:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.728968:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.728970:0:22687:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383606.728973:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9635035fe000 00000020:00000080:0.0:1787383606.728975:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383606.729098:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.729103:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.729104:0:22687:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383606.729107:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.729110:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.729111:0:22687:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383606.729115:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9635035fe000 00000020:00000080:0.0:1787383606.729117:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383606.729137:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.729140:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.729141:0:22687:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383606.729143:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383606.729145:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.729146:0:22687:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383606.729149:0:22687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9635035fe000 00000020:00000080:0.0:1787383606.729151:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787383606.729197:0:22687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22687:1874206984998656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787383606.729234:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.729268:0:22687:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4780 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.729285:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998656 00000100:00100000:2.0:1787383606.729290:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998656 00000100:00100000:2.0:1787383606.729366:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787383606.729373:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22687:x1874206984998656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.729456:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22687:x1874206984998656:12345-0@lo:502:llog_process_th.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.729469:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383606.729538:0:22687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22687:1874206984998656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787383606.729555:0:22687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383606.729570:0:22687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383606.729572:0:22687:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787383606.729576:0:22687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1787383606.730821:0:22638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787383606.730857:0:22638:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383606.730892:0:22638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.730906:0:22638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383606.730955:0:22638:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383606.730970:0:22638:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9635035fe000 10000000:01000000:0.0:1787383606.730973:0:22638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9635035fe000 10000000:01000000:0.0:1787383606.730977:0:22638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383606.730983:0:22638:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9635035fe000 from 1 10000000:01000000:0.0:1787383606.730985:0:22638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383606.731016:0:22638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.731242:0:22638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.731254:0:22638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.731287:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383606.731338:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383606.736347:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998784 00000100:00100000:3.0:1787383606.736361:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998784 00000100:00100000:3.0:1787383606.736523:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787383606.736535:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984998784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383606.736553:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383606.736571:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0400/0xc40acec91532fefe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fef7 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383606.736599:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0400/0xc40acec91532fefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fef7 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383606.736612:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0400/0xc40acec91532fefe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fef7 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383606.736621:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0400, rc 0) 00000100:00100000:3.0:1787383606.736689:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22638:x1874206984998784:12345-0@lo:101:mount.lustre.0 Request processed in 157us (5350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.736697:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383606.741236:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383606.741274:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383606.741299:0:22638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fefe expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383606.741313:0:22638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fefe expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383606.741402:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.742808:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383606.742860:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984998912 00000100:00100000:0.0:1787383606.742863:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.742868:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984998912 00000100:00100000:3.0:1787383606.742922:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383606.742933:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22638:x1874206984998912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383606.743348:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22638:x1874206984998912:12345-0@lo:501:mount.lustre.0 Request processed in 416us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.743356:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383606.743669:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984998912:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383606.743825:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984999040:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383606.743875:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.743905:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503cc4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.743997:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999040 00000100:00100000:3.0:1787383606.744002:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999040 00000100:00100000:3.0:1787383606.744129:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383606.744141:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22638:x1874206984999040:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383606.744385:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22638:x1874206984999040:12345-0@lo:503:mount.lustre.0 Request processed in 245us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.744393:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383606.744496:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984999040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383606.745394:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22691:1874206984999168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.745465:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383606.745503:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999168 00000100:00100000:2.0:1787383606.746089:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999168 00000100:00100000:2.0:1787383606.746239:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383606.746248:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22691:x1874206984999168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.746362:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22691:x1874206984999168:12345-0@lo:502:llog_process_th.0 Request processed in 115us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.746371:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383606.750570:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff963638b3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.750626:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22691:1874206984999168:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787383606.750697:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787383606.750725:0:22691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff963504593380) 00000020:00000080:2.0:1787383606.750750:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787383606.750943:0:22691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9635035fe000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787383606.750948:0:22691:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9635035fe000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787383606.750951:0:22691:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9635035fe000 4 00010000:00080000:2.0:1787383606.750991:0:22691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963636f58800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383606.755309:0:22691:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1787383606.755411:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787383606.756057:0:22691:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383606.756073:0:22691:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc40acec91532ff0c 00000100:00080000:2.0:1787383606.756082:0:22691:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383606.756088:0:22691:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff963636f58800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383606.756123:0:22691:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363d133b80 x1874206984999296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383606.756153:0:22691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383606.756848:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984999296:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383606.756918:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383606.757077:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999296 00000100:00100000:0.0:1787383606.757084:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999296 00000100:00100000:0.0:1787383606.757112:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383606.757119:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984999296:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383606.757178:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206984999296:12345-0@lo:38:llog_process_th.0 Request processed in 56us (258us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787383606.757186:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383606.757219:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383606.757227:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963636f58800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383606.757231:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787383606.757234:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206984999296:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383606.757496:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22691:1874206984999424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.757551:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383606.757625:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff963638b3ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.758209:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999424 00000100:00100000:3.0:1787383606.758214:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999424 00000100:00100000:3.0:1787383606.758339:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383606.758349:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22691:x1874206984999424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787383606.760776:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22691:x1874206984999424:12345-0@lo:502:llog_process_th.0 Request processed in 2410us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383606.760791:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383606.760972:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22691:1874206984999424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.761643:0:22691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22691:1874206984999552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.761695:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383606.761728:0:22691:0:(client.c:2702:ptlrpc_set_wait()) set ffff963638b3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383606.761748:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999552 00000100:00100000:2.0:1787383606.761754:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999552 00000100:00100000:2.0:1787383606.761816:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383606.761825:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22691:x1874206984999552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787383606.761926:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22691:x1874206984999552:12345-0@lo:502:llog_process_th.0 Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.761934:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383606.761975:0:22691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22691:1874206984999552:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787383606.761996:0:22691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787383606.762684:0:22638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787383606.762723:0:22638:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787383606.762738:0:22638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fefe expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.762750:0:22638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac8200/0xc40acec91532fef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fefe expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787383606.762827:0:22638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787383606.762830:0:22638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383606.762831:0:22638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383606.762832:0:22638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383606.762833:0:22638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383606.762835:0:22638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383606.762837:0:22638:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383606.762838:0:22638:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383606.762844:0:22638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383606.762845:0:22638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383606.762849:0:22638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787383606.762852:0:22638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383606.762853:0:22638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383606.762854:0:22638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383606.762855:0:22638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383606.762856:0:22638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383606.762857:0:22638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383606.762858:0:22638:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383606.762858:0:22638:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383606.762859:0:22638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383606.762860:0:22638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787383606.763050:0:22638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787383606.763065:0:22638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984999680:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787383606.763107:0:22638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383606.763137:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999680 00000100:00100000:1.0:1787383606.763143:0:22638:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611ac8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383606.763144:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999680 00000100:00100000:3.0:1787383606.763186:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787383606.763194:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22638:x1874206984999680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787383606.763216:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787383606.763230:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787383606.772061:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787383606.772081:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787383606.772176:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383606.772182:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383606.772206:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.772225:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fedb expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.772248:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.772287:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532fedb expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.772301:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532fedb expref: 12 pid: 22652 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383606.772315:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206984999808:0@lo:104: 00000100:00100000:2.0:1787383606.772369:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383606.772406:0:22675:0:(client.c:2702:ptlrpc_set_wait()) set ffff963638b3ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787383606.772475:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999808 00000100:00100000:1.0:1787383606.772482:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999808 00000100:00100000:1.0:1787383606.772521:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383606.772529:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206984999808:12345-0@lo:104: 00010000:00010000:1.0:1787383606.772541:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.772835:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383606.772842:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206984999808:12345-0@lo:104: Request processed in 313us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383606.772850:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383606.772889:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206984999808:0@lo:104: 00010000:00010000:1.0:1787383606.772908:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.772976:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383606.772982:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.772990:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383606.772994:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773002:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383606.773010:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383606.773016:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383606.773059:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773078:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383606.773106:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773114:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636082a7200/0xc40acec91532fedb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fee2 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773130:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383606.773132:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383606.773134:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383606.773146:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206984999936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383606.773183:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383606.773232:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206984999936 00000100:00100000:2.0:1787383606.773236:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206984999936 00010000:00010000:2.0:1787383606.773258:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532fedb expref: 13 pid: 22652 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383606.773277:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383606.773283:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+13:3648:x1874206984999936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383606.773292:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383606.773297:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532fedb expref: 13 pid: 22652 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773307:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532fedb expref: 13 pid: 22652 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773320:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9e00/0xc40acec91532fee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532fedb expref: 13 pid: 22652 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773332:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773350:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787383606.773362:0:22644:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001181267s 00010000:00010000:2.0:1787383606.773367:0:22644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773374:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773381:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773387:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773393:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383606.773397:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773404:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773423:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383606.773432:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383606.773526:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:3648:x1874206984999936:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.773532:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787383606.773858:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.773868:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383606.773874:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9a00/0xc40acec91532ff13 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383606.773896:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206984999936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383606.773975:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22638:x1874206984999680:12345-0@lo:253:mount.lustre.0 Request processed in 10779us (10865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383606.773983:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383606.774057:0:22638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22638:1874206984999680:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787383606.774067:0:22638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787383606.774070:0:22638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383606.774072:0:22638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787383606.774073:0:22638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383606.774074:0:22638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383606.774075:0:22638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383606.774076:0:22638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383606.774078:0:22638:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787383606.774079:0:22638:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787383606.774081:0:22638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383606.774082:0:22638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787383606.774099:0:22638:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1787383606.795567:0:22638:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1787383606.796203:0:22638:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787383606.796350:0:22699:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1787383606.796355:0:22699:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1787383606.797225:0:22700:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1787383606.797740:0:22700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787383606.800258:0:22638:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1787383606.802388:0:22700:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000100:00080000:3.0:1787383606.803107:0:22701:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff96363ca53480 x1874206985000064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383606.803120:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000040:01000000:2.0:1787383606.803468:0:22638:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000004:00080000:1.0:1787383606.803628:0:22700:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1787383606.803859:0:22638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787383606.804386:0:22638:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787383606.804394:0:22638:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787383606.804434:0:22638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383606.806203:0:22638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787383606.807049:0:22638:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787383606.807094:0:22638:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787383606.808006:0:22638:0:(llog_cat.c:1220:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1787383606.808605:0:22638:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1787383606.811286:0:22638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787383606.813372:0:22638:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787383606.813406:0:22638:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb73d80c8f988 00100000:10000000:3.0:1787383606.813413:0:22638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787383606.815691:0:22638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787383606.815718:0:22638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787383606.815738:0:22638:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787383606.815759:0:22638:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787383606.821653:0:22638:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383606.821881:0:22638:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383607.462037:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383607.775250:0:22695:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787383607.775259:0:22695:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383607.779901:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787383607.779917:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787383607.835061:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787383608.475081:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787383608.476130:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787383608.476136:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9635035fe000 from 11 10000000:01000000:2.0:1787383608.476141:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787383608.476253:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383608.476265:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383608.476277:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383608.476302:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d133800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985000192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787383608.476365:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383608.476424:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383608.480020:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000192 00000100:00100000:3.0:1787383608.480036:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000192 00000100:00100000:3.0:1787383608.480104:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787383608.480113:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+11:22656:x1874206985000192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383608.480130:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383608.480150:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532ff1a expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383608.480175:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532ff1a expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383608.480187:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ff1a expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383608.480209:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0a00, rc 0) 00000100:00100000:3.0:1787383608.480294:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22656:x1874206985000192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (3926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383608.480301:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383608.480435:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d133800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985000192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383608.480451:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383608.480463:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383608.480522:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d133800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985000320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787383608.480559:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383608.480595:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383608.480704:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000320 00000100:00100000:1.0:1787383608.480714:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000320 00000100:00100000:1.0:1787383608.480806:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383608.480814:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22656:x1874206985000320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787383608.480827:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787383608.480842:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787383608.480844:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787383608.480926:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:22656:x1874206985000320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383608.480934:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383608.480994:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d133800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985000320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383608.481041:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383608.481049:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383608.481057:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383608.797352:0:22695:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787383608.797361:0:22695:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383608.798117:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1787383608.798162:0:22695:0:(llog_cat.c:1263:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787383608.798814:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1787383608.858879:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787383609.502559:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383609.889933:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787383610.525645:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383610.906891:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787383611.547473:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787383611.571155:0:22944:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787383611.931833:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000100:00080000:3.0:1787383612.059445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787383612.059453:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787383612.059457:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383612.059467:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:3.0:1787383612.059474:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787383612.059481:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363cd5b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383612.059509:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca51180 x1874206985000576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383612.059524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383612.059528:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383612.059532:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383612.059535:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383612.059538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787383612.059542:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787383612.059543:0:8:0:(import.c:65:import_set_state_nolock()) ffff963636f58800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383612.059547:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff963636f58800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383612.059559:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca51880 x1874206985000704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383612.059636:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787383612.059650:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985000448:0@lo:400:kworker.0 00000100:00100000:3.0:1787383612.059795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383612.059875:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000448 00000100:00100000:3.0:1787383612.059884:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000448 00000100:00100000:2.0:1787383612.060114:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985000576:0@lo:38:kworker.0 00000100:00100000:2.0:1787383612.060154:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383612.060178:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206985000704:0@lo:38:kworker.0 00000100:00100000:2.0:1787383612.060209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383612.060284:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000576 00000100:00100000:2.0:1787383612.060289:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000576 00000100:00100000:2.0:1787383612.060332:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383612.060341:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985000576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787383612.060365:0:22665:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787383612.060422:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985000576:12345-0@lo:38:kworker.0 Request processed in 80us (266us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383612.060431:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787383612.060480:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383612.060486:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787383612.060489:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985000576:0@lo:38:kworker.0 00000100:00100000:3.0:1787383612.060847:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383612.060862:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:3650:x1874206985000448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383612.060918:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:3650:x1874206985000448:12345-0@lo:400:kworker.0 Request processed in 62us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383612.062155:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383612.062241:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000704 00000100:00100000:3.0:1787383612.062249:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000704 00000100:00100000:3.0:1787383612.062295:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383612.062302:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206985000704:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787383612.062351:0:22661:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 645 last 0 00000020:00000080:3.0:1787383612.062397:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc40acec91532ff28 00000004:00100000:3.0:1787383612.062414:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787383612.062572:0:22661:0:(import.c:65:import_set_state_nolock()) ffff963503116800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383612.062665:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1874206985000704:12345-0@lo:38:kworker.0 Request processed in 361us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383612.062673:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383612.062745:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985000448:0@lo:400:kworker.0 00010000:00080000:1.0:1787383612.062800:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96363ca51880 x1874206985000704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383612.062824:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787383612.062834:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787383612.062840:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787383612.062844:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963636f58800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383612.062853:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1874206985000704:0@lo:38:kworker.0 00010000:00010000:1.0:1787383612.572618:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383612.616014:0:22996:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383612.616288:0:22996:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787383612.954865:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000020:00000004:0.0:1787383613.555466:0:23047:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383613.555646:0:23047:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383613.596048:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383613.979891:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787383614.619021:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383615.002863:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787383615.642931:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383616.026922:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000100:00100000:1.0:1787383616.155358:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383606/real 1787383606] req@ffff963503e90700 x1874206984997632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383616.155386:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e90700 x1874206984997632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383616.155414:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383606/real 1787383606] req@ffff96363692a680 x1874206984997504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383616.155426:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363692a680 x1874206984997504/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383616.155443:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383616.155471:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383616.155476:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984997632:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787383616.155482:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383616.155487:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383616.155490:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206984997504:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787383616.155645:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787383616.155649:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787383616.155652:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383616.155656:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 645 00000100:00080000:0.0:1787383616.155662:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787383616.155668:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363cd5b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383616.155687:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e92680 x1874206985000960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383616.155707:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383616.155710:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787383616.155712:0:36:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383616.155716:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:0.0:1787383616.155718:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383616.155722:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96361122b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383616.155735:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e91880 x1874206985001088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383616.155742:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383616.155744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383616.155746:0:36:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383616.155748:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 639 00000100:00080000:0.0:1787383616.155750:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787383616.155753:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9636064d6800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383616.155762:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e93480 x1874206985001216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383616.155820:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985001344:0@lo:400:kworker.0 00000100:00100000:0.0:1787383616.155876:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383616.155940:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985001344 00000100:00100000:0.0:1787383616.155948:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985001344 00000100:00100000:0.0:1787383616.155992:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383616.156001:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985001344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383616.156050:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985001344:12345-0@lo:400:kworker.0 Request processed in 50us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383616.156067:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787383616.156103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff963503e91500 x1874206985001344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383616.156115:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985001344:0@lo:400:kworker.0 00000100:00100000:3.0:1787383616.156263:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985000832:0@lo:400:kworker.0 00000100:00100000:3.0:1787383616.156302:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383616.156372:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000832 00000100:00100000:0.0:1787383616.156376:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000832 00000100:00100000:0.0:1787383616.156407:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787383616.156415:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:3650:x1874206985000832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383616.156519:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:3650:x1874206985000832:12345-0@lo:400:kworker.0 Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383616.156527:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787383616.156556:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985000832:0@lo:400:kworker.0 00000100:00100000:1.0:1787383616.156623:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985000960:0@lo:38:kworker.0 00000100:00100000:1.0:1787383616.156689:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383616.156710:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985001088:0@lo:8:kworker.0 00000400:00000100:1.0:1787383616.156731:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985001088 offset 0 length 520: 4 00000100:00100000:1.0:1787383616.156742:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985001216:0@lo:8:kworker.0 00000400:00000100:1.0:1787383616.156756:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985001216 offset 0 length 520: 4 00000100:00100000:3.0:1787383616.156922:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000960 00000100:00100000:3.0:1787383616.156928:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000960 00000100:00100000:3.0:1787383616.156965:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383616.156971:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985000960:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787383616.156987:0:22665:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787383616.157031:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985000960:12345-0@lo:38:kworker.0 Request processed in 59us (340us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787383616.157038:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787383616.157069:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383616.157075:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787383616.157079:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985000960:0@lo:38:kworker.0 00010000:00010000:3.0:1787383616.667245:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383617.052835:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787383617.691231:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383618.015586:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787383618.078003:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1787383618.717185:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383619.098835:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1787383619.742211:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383620.123826:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000020:01000004:3.0:1787383620.601114:0:23392:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787383620.601118:0:23392:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787383620.601119:0:23392:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787383620.601228:0:23392:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff963503110800 00000020:01000004:3.0:1787383620.601242:0:23392:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787383620.601253:0:23392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787383620.601267:0:23392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff96363cd54d40) 00000020:00000080:3.0:1787383620.601283:0:23392:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787383620.686670:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787383620.687033:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787383620.693111:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787383620.694681:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787383620.695161:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787383620.696148:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787383620.696397:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787383620.696562:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787383620.697321:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787383620.698236:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787383620.698511:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787383620.698684:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787383620.702582:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787383620.703183:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787383620.705701:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787383620.706090:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787383620.706341:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787383620.706676:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787383620.707233:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787383620.707851:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787383620.709225:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787383620.709552:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787383620.710236:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787383620.710465:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.713013:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.713453:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.713719:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.714067:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.714303:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.714489:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.714665:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.714934:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.715129:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.715322:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.715510:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.715688:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.716004:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.716998:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.717259:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.717476:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.718023:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.718981:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.719998:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.720327:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787383620.720633:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1787383620.720828:0:23392:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:0.0:1787383620.731530:0:23392:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787383620.731836:0:23392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787383620.731854:0:23392:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787383620.732341:0:23392:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532ff36 00000020:01000004:0.0:1787383620.732349:0:23392:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787383620.732372:0:23392:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787383620.732376:0:23392:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787383620.732383:0:23392:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787383620.732415:0:23392:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787383620.732419:0:23392:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1787383620.752141:0:23392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787383620.752184:0:23392:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1787383620.752188:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787383620.752190:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787383620.752191:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383620.752192:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383620.752194:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383620.752195:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383620.752197:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383620.752198:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383620.752200:0:23392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383620.752203:0:23392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1787383620.752205:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383620.752207:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787383620.752208:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383620.752209:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383620.752210:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383620.752211:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383620.752212:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383620.752213:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383620.752214:0:23392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787383620.752241:0:23392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1787383620.752261:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787383620.752328:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.752415:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963634734f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383620.762331:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985001472 00000100:00100000:2.0:1787383620.762346:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985001472 00000100:00100000:2.0:1787383620.762413:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787383620.762423:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:23392:x1874206985001472:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787383620.762459:0:22652:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787383620.762473:0:22652:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1787383620.762481:0:22652:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787383620.763051:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:23392:x1874206985001472:12345-0@lo:253:mount.lustre.0 Request processed in 627us (10720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383620.763060:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383620.763149:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383620.763163:0:23392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1787383620.763181:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383620.763182:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1787383620.763184:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383620.763185:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383620.763186:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383620.763188:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383620.763189:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787383620.763190:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383620.763192:0:23392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787383620.763211:0:23392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff963503110800 from lustre-MDT0001 10000000:01000000:0.0:1787383620.763239:0:23392:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1787383620.763242:0:23392:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787383620.763249:0:23392:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636352c99c0 local copy 00010000:00010000:0.0:1787383620.763259:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383620.763356:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383620.763389:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.763426:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383620.763564:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985001600 00000100:00100000:1.0:1787383620.763570:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985001600 00000100:00100000:1.0:1787383620.763604:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383620.763611:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:23392:x1874206985001600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383620.763675:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:23392:x1874206985001600:12345-0@lo:501:mount.lustre.0 Request processed in 65us (285us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787383620.763690:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383620.763761:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001600:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787383620.763801:0:23392:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787383620.763817:0:23392:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787383620.763823:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.763831:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383620.763876:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff963503110800 10000000:01000000:0.0:1787383620.763881:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787383620.763886:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9636352c99c0 10000000:01000000:0.0:1787383620.763894:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787383620.763898:0:23392:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9636352c99c0 from 1 10000000:01000000:0.0:1787383620.763900:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787383620.763937:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.763945:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.763953:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383620.763966:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383620.763988:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.764004:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383620.764102:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985001728 00000100:00100000:1.0:1787383620.764107:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985001728 00000100:00100000:1.0:1787383620.764123:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383620.764128:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+12:23392:x1874206985001728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383620.764136:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383620.764149:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636082a6c00/0xc40acec91532ff44 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532ff3d expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383620.764166:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636082a6c00/0xc40acec91532ff44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532ff3d expref: 13 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383620.764176:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636082a6c00/0xc40acec91532ff44 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ff3d expref: 13 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383620.764183:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a6c00, rc 0) 00000100:00100000:1.0:1787383620.764219:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+13:23392:x1874206985001728:12345-0@lo:101:mount.lustre.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.764225:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1787383620.764557:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383620.765217:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383620.765234:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff44 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765245:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532ff44 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383620.765263:0:23392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787383620.765279:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff44 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765287:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac8a00/0xc40acec91532ff3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff44 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383620.765296:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff963503110800 10000000:01000000:0.0:1787383620.765310:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787383620.765315:0:23392:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff963503110800 from 1 10000000:01000000:0.0:1787383620.765318:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787383620.765337:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765346:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765353:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383620.765368:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383620.765400:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.765423:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383620.765601:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985001856 00000100:00100000:1.0:1787383620.765607:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985001856 00000100:00100000:1.0:1787383620.765648:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383620.765655:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+13:23392:x1874206985001856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383620.765664:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383620.765673:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636082a6e00/0xc40acec91532ff52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532ff4b expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383620.765687:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636082a6e00/0xc40acec91532ff52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532ff4b expref: 14 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383620.765702:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636082a6e00/0xc40acec91532ff52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ff4b expref: 14 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383620.765709:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a6e00, rc 0) 00000100:00100000:1.0:1787383620.765743:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+14:23392:x1874206985001856:12345-0@lo:101:mount.lustre.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.765748:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787383620.765845:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383620.765854:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff52 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765871:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532ff52 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383620.765881:0:23392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787383620.765888:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff52 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765895:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac9800/0xc40acec91532ff4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff52 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383620.765900:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787383620.765908:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383620.765913:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff963503110800 10000000:01000000:0.0:1787383620.765915:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787383620.765918:0:23392:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787383620.765920:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787383620.765945:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765951:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.765958:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383620.765970:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383620.765994:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.766019:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.766111:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985001984 00000100:00100000:3.0:1787383620.766116:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985001984 00000100:00100000:3.0:1787383620.766144:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787383620.766151:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+14:23392:x1874206985001984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383620.766158:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383620.766166:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0800/0xc40acec91532ff60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532ff59 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.766180:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0800/0xc40acec91532ff60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532ff59 expref: 15 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.766189:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0800/0xc40acec91532ff60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ff59 expref: 15 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.766195:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0800, rc 0) 00000100:00100000:3.0:1787383620.766220:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985001984:12345-0@lo:101:mount.lustre.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.766226:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787383620.766554:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985001984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383620.766564:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff60 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.766571:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532ff60 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383620.773801:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:1.0:1787383620.775130:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383620.781354:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787383620.781408:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:1.0:1787383620.781421:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:1.0:1787383620.781432:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:1.0:1787383620.781442:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:1.0:1787383620.781453:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:1.0:1787383620.781853:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:1.0:1787383620.781953:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:1.0:1787383620.781969:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:1.0:1787383620.781982:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:1.0:1787383620.781996:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:1.0:1787383620.782009:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:1.0:1787383620.782028:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:1.0:1787383620.782042:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:1.0:1787383620.782054:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:1.0:1787383620.782067:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:1.0:1787383620.782080:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:1.0:1787383620.782091:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:1.0:1787383620.782102:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:1.0:1787383620.782116:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:1.0:1787383620.782130:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:1.0:1787383620.782162:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:1.0:1787383620.782177:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:1.0:1787383620.782195:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:1.0:1787383620.782208:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:1.0:1787383620.782219:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:1.0:1787383620.782230:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:1.0:1787383620.782243:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:1.0:1787383620.782257:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:1.0:1787383620.782271:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:1.0:1787383620.782285:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:1.0:1787383620.782300:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:1.0:1787383620.782315:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:1.0:1787383620.782326:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:1.0:1787383620.782336:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:1.0:1787383620.782346:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:1.0:1787383620.782359:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:1.0:1787383620.782371:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:1.0:1787383620.782382:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:1.0:1787383620.782394:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:1.0:1787383620.782407:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:1.0:1787383620.782419:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:1.0:1787383620.782432:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:1.0:1787383620.782443:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:1.0:1787383620.785749:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:1.0:1787383620.786041:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:1.0:1787383620.786164:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383620.786227:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.786313:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.790518:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002112 00000100:00100000:3.0:1787383620.790534:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002112 00000100:00100000:3.0:1787383620.790660:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383620.790670:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383620.790878:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002112:12345-0@lo:501:mount.lustre.0 Request processed in 209us (4649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.790885:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787383620.790982:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383620.791025:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383620.791078:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.792483:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383620.792970:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002240 00000100:00100000:2.0:1787383620.792978:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002240 00000100:00100000:2.0:1787383620.793025:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787383620.793033:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383620.794077:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002240:12345-0@lo:503:mount.lustre.0 Request processed in 1040us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383620.794088:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383620.794189:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383620.794648:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383620.794723:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.794814:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.794840:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636038ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1787383620.795018:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002368 00000100:00100000:2.0:1787383620.795025:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002368 00000100:00100000:2.0:1787383620.795054:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787383620.795061:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383620.795747:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002368:12345-0@lo:502:mount.lustre.0 Request processed in 684us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383620.795756:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383620.795983:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.796171:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787383620.796203:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1787383620.796222:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1787383620.796238:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1787383620.796254:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1787383620.796268:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1787383620.796283:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1787383620.796300:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1787383620.796316:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1787383620.796332:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1787383620.796348:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1787383620.796363:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1787383620.796378:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1787383620.796392:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1787383620.796408:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1787383620.796423:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1787383620.796437:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1787383620.796449:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1787383620.796535:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1787383620.796561:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1787383620.796575:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1787383620.796601:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1787383620.796624:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1787383620.796641:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1787383620.796657:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1787383620.796671:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1787383620.796684:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1787383620.796698:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1787383620.796713:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1787383620.796728:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1787383620.796743:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1787383620.796760:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1787383620.798056:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1787383620.798080:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1787383620.798093:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1787383620.798105:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1787383620.798119:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1787383620.798133:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1787383620.798145:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1787383620.798156:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1787383620.798169:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1787383620.798181:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1787383620.798193:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1787383620.798204:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1787383620.798247:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.798321:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.798452:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.798556:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002496 00000100:00100000:3.0:1787383620.798563:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002496 00000100:00100000:3.0:1787383620.798653:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383620.798663:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383620.798808:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985002496:12345-0@lo:502:mount.lustre.0 Request processed in 145us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.798816:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787383620.798960:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985002496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.799011:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1787383620.799020:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1787383620.800258:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.800270:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.800278:0:23396:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787383620.800285:0:23396:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1787383620.800288:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383620.800301:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9635033c3380) 00000020:00000080:1.0:1787383620.800320:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1787383620.800325:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787383620.800389:0:23396:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787383620.800395:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532ff6e 00000020:00000080:1.0:1787383620.800671:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787383620.800675:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.800679:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.800681:0:23396:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787383620.800683:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.800686:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.800687:0:23396:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787383620.800690:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383620.800700:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9635033c19c0) 00000020:00000080:1.0:1787383620.800711:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1787383620.800713:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787383620.800715:0:23396:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787383620.800718:0:23396:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787383620.800723:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787383620.800813:0:23396:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963503110800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787383620.800826:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9635033c4d40) 00000020:00000080:1.0:1787383620.800835:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1787383620.800962:0:23396:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787383620.800968:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532ff83 00000020:00000080:1.0:1787383620.801069:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787383620.801076:0:23396:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787383620.801081:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xc40acec91532ff8a 00080000:01000000:1.0:1787383620.801086:0:23396:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787383620.801089:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532ff91 00010000:00010000:2.0:1787383620.881401:0:23396:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787383620.882571:0:23396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787383620.883606:0:23396:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787383620.886475:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787383620.886490:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383620.886497:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.886499:0:23396:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787383620.886503:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383620.886509:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.886511:0:23396:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787383620.886514:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787383620.886520:0:23396:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:00000080:2.0:1787383620.886548:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383620.886564:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff963504590000) 00000020:00000080:2.0:1787383620.886586:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787383620.886592:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787383620.886663:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787383620.886670:0:23396:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787383620.886689:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532ff9f 00010000:00080000:2.0:1787383620.886736:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963620417000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383620.896284:0:23396:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787383620.904162:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787383620.904186:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787383620.904232:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787383620.904254:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532ffa6 00000100:00080000:1.0:1787383620.904264:0:23396:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383620.904270:0:23396:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff963620417000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383620.904321:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963636929880 x1874206985002624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383620.904352:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787383620.904599:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985002624:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787383620.904673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.904799:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002624 00000100:00100000:0.0:1787383620.904807:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002624 00000100:00100000:0.0:1787383620.904838:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787383620.904853:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985002624:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787383620.904896:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:0.0:1787383620.904947:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532ffad 00000004:00100000:0.0:1787383620.904962:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787383620.904968:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:1.0:1787383620.905806:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.905812:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.905814:0:23396:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787383620.905817:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383620.905819:0:23396:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787383620.905821:0:23396:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383620.905822:0:23396:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383620.905824:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383620.905826:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.905827:0:23396:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383620.905829:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.905833:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.905834:0:23396:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787383620.905837:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787383620.905883:0:23396:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787383620.905894:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.905897:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.905898:0:23396:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787383620.905900:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787383620.905902:0:23396:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1787383620.905903:0:23396:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383620.905904:0:23396:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787383620.905906:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787383620.905908:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.905929:0:23396:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787383620.905933:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787383620.905936:0:23396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787383620.905940:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.905942:0:23396:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787383620.905944:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787383620.905948:0:23396:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:1.0:1787383620.905967:0:23396:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787383620.905969:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787383620.905992:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff963628163380) 00000020:00000080:1.0:1787383620.906007:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787383620.906012:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787383620.906071:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787383620.906078:0:23396:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787383620.906084:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532ffbb 00010000:00080000:1.0:1787383620.906115:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963503f63000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383620.906331:0:23396:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1787383620.909116:0:23396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787383620.909813:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787383620.912606:0:22665:0:(import.c:65:import_set_state_nolock()) ffff963503f67800 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1787383620.912962:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383620.913254:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206985002624:12345-0@lo:38:llog_process_th.0 Request processed in 8399us (8578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.913269:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787383620.913383:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787383620.913389:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787383620.913392:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383620.913396:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:3.0:1787383620.913400:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787383620.913405:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363cd5b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383620.913434:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca53800 x1874206985002752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383620.913448:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.913451:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.913454:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.913456:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383620.913626:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383620.913640:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985002880:0@lo:400:kworker.0 00000100:00100000:1.0:1787383620.913686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787383620.914158:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787383620.914337:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1787383620.914715:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002880 00000100:00100000:3.0:1787383620.914725:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002880 00000100:00100000:3.0:1787383620.914788:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383620.914797:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985002880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383620.914856:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985002880:12345-0@lo:400:kworker.0 Request processed in 60us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.914874:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787383620.915173:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96363ca51500 x1874206985002880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383620.915186:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985002880:0@lo:400:kworker.0 00000040:00080000:0.0:1787383620.915324:0:23401:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787383620.915328:0:23401:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787383620.916186:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787383620.916199:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787383620.916238:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787383620.916260:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532ffc2 00000100:00080000:0.0:1787383620.916268:0:23396:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787383620.916273:0:23396:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff963503f63000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383620.916302:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e92300 x1874206985003008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383620.916316:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787383620.916411:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383620.916416:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383620.916418:0:23396:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787383620.916421:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787383620.916423:0:23396:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787383620.916424:0:23396:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383620.916426:0:23396:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787383620.916427:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787383620.916429:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383620.916436:0:23396:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787383620.916439:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787383620.916443:0:23396:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787383620.916446:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383620.916447:0:23396:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787383620.916450:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787383620.916453:0:23396:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.102@tcp to nid 0x20000c0a8cb66 (192.168.203.102@tcp) 00000020:01000000:0.0:1787383620.916488:0:23396:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787383620.916492:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787383620.916504:0:23396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9635027399c0) 00000020:00000080:0.0:1787383620.916517:0:23396:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1787383620.916523:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787383620.916585:0:23396:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1787383620.916592:0:23396:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787383620.916600:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xc40acec91532ffd0 00010000:00080000:0.0:1787383620.916630:0:23396:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363db9f000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:0.0:1787383620.916892:0:23396:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1787383620.917144:0:23396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787383620.917158:0:23396:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1787383620.917642:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383620.917653:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787383620.917660:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787383620.917666:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787383620.917669:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963620417000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787383620.917690:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985002624:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383620.917811:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985002752:0@lo:38:kworker.0 00000100:00100000:1.0:1787383620.917894:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.917943:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985003008:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787383620.917979:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985003008 offset 0 length 520: 4 00000100:00100000:2.0:1787383620.918225:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985002752 00000100:00100000:2.0:1787383620.918231:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985002752 00000100:00100000:2.0:1787383620.918267:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383620.918274:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206985002752:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787383620.918329:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1874206985002752:12345-0@lo:38:kworker.0 Request processed in 54us (435us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787383620.918335:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383620.918361:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383620.918365:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383620.918368:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787383620.918372:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985002752:0@lo:38:kworker.0 00000100:00100000:0.0:1787383620.918518:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985003136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383620.918548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383620.918661:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985003136 00000100:00100000:2.0:1787383620.918665:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985003136 00000100:00100000:2.0:1787383620.918687:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383620.918693:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206985003136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383620.918720:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383620.918838:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206985003136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 145us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383620.918857:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383620.919712:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985003136:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787383620.921147:0:23396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383620.921355:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787383620.921534:0:23396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1787383620.921985:0:23403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787383620.921990:0:23403:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787383620.922648:0:23396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787383620.922661:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787383620.922698:0:23396:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787383620.922719:0:23396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec91532ffd7 00000100:00080000:2.0:1787383620.922729:0:23396:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383620.922734:0:23396:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96363db9f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383620.923003:0:23396:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363d131880 x1874206985003264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383620.923030:0:23396:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787383620.923094:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383620.923098:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.923100:0:23396:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787383620.923104:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383620.923107:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.923109:0:23396:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383620.923112:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383620.923114:0:23396:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787383620.923117:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383620.923119:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.923120:0:23396:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787383620.923123:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383620.923126:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.923127:0:23396:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787383620.923131:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787383620.923155:0:23396:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383620.923158:0:23396:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383620.923159:0:23396:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787383620.923162:0:23396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1787383620.923314:0:23392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1787383620.923348:0:23392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1787383620.923372:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff60 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923383:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac8600/0xc40acec91532ff59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ff60 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383620.923391:0:23392:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963503110800 from 1 10000000:01000000:3.0:1787383620.923394:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383620.923422:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923431:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923441:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383620.923470:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383620.923533:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.923566:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.923595:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985003392 00000100:00100000:3.0:1787383620.923601:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985003392 00000100:00100000:3.0:1787383620.923644:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383620.923652:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+15:23392:x1874206985003392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383620.923664:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383620.923675:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532ffde expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923695:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532ffde expref: 16 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923705:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ffde expref: 16 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923712:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:3.0:1787383620.923746:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:23392:x1874206985003392:12345-0@lo:101:mount.lustre.0 Request processed in 94us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.923751:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383620.923824:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383620.923837:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.923845:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383620.924465:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003520:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787383620.924503:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.924527:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.924552:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985003520 00000100:00100000:3.0:1787383620.924556:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985003520 00000100:00100000:3.0:1787383620.924580:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383620.924586:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:23392:x1874206985003520:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787383620.924600:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787383620.924615:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787383620.924618:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1787383620.924687:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:23392:x1874206985003520:12345-0@lo:256:mount.lustre.0 Request processed in 100us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.924694:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383620.924729:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003520:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787383620.925331:0:23392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383620.925340:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925350:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383620.925358:0:23392:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963503110800 from 1 10000000:01000000:3.0:1787383620.925361:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383620.925382:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925389:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925399:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383620.925413:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383620.925450:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.925475:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a180 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.925493:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985003648 00000100:00100000:3.0:1787383620.925498:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985003648 00000100:00100000:3.0:1787383620.925524:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787383620.925531:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:23392:x1874206985003648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383620.925540:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383620.925550:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532ffec expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925567:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532ffec expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925576:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ffec expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925585:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1400, rc 0) 00000100:00100000:3.0:1787383620.925614:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985003648:12345-0@lo:101:mount.lustre.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.925620:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787383620.925653:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383620.925665:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383620.925673:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787383620.925976:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.925987:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.925990:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.925993:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.926004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.926007:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.926009:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.926011:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383620.926262:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985003264:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787383620.926295:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985003264 offset 0 length 520: 4 00000040:00080000:3.0:1787383620.927316:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1787383620.927651:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383620.928422:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787383620.928454:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1787383620.928553:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1787383620.928581:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1787383620.928594:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1787383620.928608:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1787383620.928623:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1787383620.928638:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1787383620.928652:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787383620.928667:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1787383620.928683:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1787383620.928706:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1787383620.928712:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1787383620.928940:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383620.929001:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.929081:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831be40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.929123:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985003776 00000100:00100000:3.0:1787383620.929130:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985003776 00000100:00100000:3.0:1787383620.929206:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383620.929216:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985003776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383620.929334:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985003776:12345-0@lo:501:mount.lustre.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.929342:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383620.929418:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383620.929455:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383620.929506:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.934333:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fea900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383620.937130:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985003904 00000100:00100000:0.0:1787383620.937145:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985003904 00000100:00100000:0.0:1787383620.937209:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787383620.937220:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985003904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383620.937387:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985003904:12345-0@lo:503:mount.lustre.0 Request processed in 169us (7879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383620.937396:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787383620.937628:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985003904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383620.938110:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383620.938199:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.938249:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.938287:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fea900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383620.938425:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004032 00000100:00100000:0.0:1787383620.938430:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004032 00000100:00100000:0.0:1787383620.938454:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787383620.938532:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985004032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383620.938626:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985004032:12345-0@lo:502:mount.lustre.0 Request processed in 164us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383620.938634:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787383620.938845:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.939079:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787383620.939107:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1787383620.939121:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1787383620.939135:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1787383620.939148:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1787383620.939159:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1787383620.939172:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1787383620.939185:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1787383620.939198:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787383620.939211:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1787383620.939238:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1787383620.939263:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.939302:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.939385:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fea900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383620.939453:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004160 00000100:00100000:2.0:1787383620.939458:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004160 00000100:00100000:0.0:1787383620.939664:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787383620.939672:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985004160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383620.939796:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985004160:12345-0@lo:502:mount.lustre.0 Request processed in 124us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383620.939804:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383620.939894:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.939944:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1787383620.939954:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787383620.940646:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.940656:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.940658:0:23405:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787383620.940665:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963503110800 00000020:00000080:1.0:1787383620.940668:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383620.940675:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.940678:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.940679:0:23405:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787383620.940681:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.940683:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.940685:0:23405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787383620.940688:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff963503110800 00000020:00000080:1.0:1787383620.940690:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383620.940879:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.940884:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.940885:0:23405:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787383620.940888:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.940891:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.940892:0:23405:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383620.940895:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963503110800 00000020:00000080:1.0:1787383620.940897:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383620.943877:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.943890:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.943892:0:23405:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787383620.943896:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787383620.943906:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.943908:0:23405:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787383620.943914:0:23405:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff963503110800 00000020:00000080:1.0:1787383620.943916:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787383620.943980:0:23405:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787383620.943984:0:23405:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787383620.943985:0:23405:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787383620.943988:0:23405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1787383620.944217:0:23392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787383620.944250:0:23392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383620.944275:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944288:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383620.944340:0:23392:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787383620.944344:0:23392:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff963503110800 10000000:01000000:0.0:1787383620.944347:0:23392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff963503110800 10000000:01000000:0.0:1787383620.944351:0:23392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787383620.944357:0:23392:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff963503110800 from 1 10000000:01000000:0.0:1787383620.944360:0:23392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787383620.944394:0:23392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944401:0:23392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944410:0:23392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383620.944433:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383620.944509:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.944546:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787383620.944576:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004288 00000100:00100000:0.0:1787383620.944582:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004288 00000100:00100000:0.0:1787383620.944623:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787383620.944632:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:23392:x1874206985004288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383620.944645:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383620.944656:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac8400/0xc40acec915330001 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91532fffa expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944678:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac8400/0xc40acec915330001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91532fffa expref: 18 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944689:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac8400/0xc40acec915330001 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fffa expref: 18 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944698:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8400, rc 0) 00000100:00100000:0.0:1787383620.944735:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004288:12345-0@lo:101:mount.lustre.0 Request processed in 105us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383620.944742:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787383620.944820:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383620.944833:0:23392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330001 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383620.944841:0:23392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330001 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383620.947265:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1787383620.947617:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383620.947841:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1787383620.947936:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1787383620.947966:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1787383620.947979:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1787383620.947992:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1787383620.948002:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1787383620.948013:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1787383620.948026:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1787383620.948039:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1787383620.948069:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1787383620.948085:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1787383620.948099:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1787383620.948111:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1787383620.948123:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1787383620.948134:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1787383620.948145:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1787383620.948156:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1787383620.948166:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1787383620.948179:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1787383620.948191:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1787383620.948202:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1787383620.948214:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1787383620.948225:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1787383620.948239:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1787383620.948253:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1787383620.948280:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1787383620.948295:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1787383620.948307:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1787383620.948320:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1787383620.948333:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1787383620.948346:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1787383620.948356:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1787383620.948367:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1787383620.948379:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1787383620.948390:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1787383620.948412:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1787383620.948423:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1787383620.948435:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1787383620.948447:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1787383620.948459:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1787383620.950619:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1787383620.950649:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1787383620.950661:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1787383620.950672:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1787383620.950683:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1787383620.950694:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1787383620.950704:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1787383620.950715:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1787383620.952345:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1787383620.952394:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1787383620.952416:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1787383620.952421:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1787383620.953389:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004416:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383620.953450:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383620.953659:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963634734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383620.953679:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004416 00000100:00100000:0.0:1787383620.953683:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004416 00000100:00100000:0.0:1787383620.955716:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787383620.955733:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383620.955908:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004416:12345-0@lo:501:mount.lustre.0 Request processed in 180us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383620.955917:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787383620.958481:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383620.958537:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787383620.958597:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.959280:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618feaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383620.959394:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004544 00000100:00100000:2.0:1787383620.959401:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004544 00000100:00100000:2.0:1787383620.959440:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787383620.959448:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383620.959582:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004544:12345-0@lo:503:mount.lustre.0 Request processed in 133us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383620.959588:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383620.963376:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004544:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787383620.963874:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787383620.963960:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004672:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.964030:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.964072:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004672 00000100:00100000:1.0:1787383620.964078:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004672 00000100:00100000:1.0:1787383620.964112:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383620.964120:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.964217:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004672:12345-0@lo:502:mount.lustre.0 Request processed in 96us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.964398:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383620.964448:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618feaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383620.964473:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004672:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.964634:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1787383620.964667:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1787383620.964681:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1787383620.964693:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1787383620.964705:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1787383620.964730:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1787383620.964744:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1787383620.964755:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1787383620.964786:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1787383620.964801:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1787383620.964814:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1787383620.964827:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1787383620.964839:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1787383620.964852:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1787383620.964983:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1787383620.965000:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1787383620.965013:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1787383620.965026:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1787383620.965039:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1787383620.965051:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1787383620.965062:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1787383620.965087:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1787383620.965102:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1787383620.965113:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1787383620.965124:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1787383620.965135:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1787383620.965145:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1787383620.965155:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1787383620.965164:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1787383620.965174:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1787383620.965184:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1787383620.965194:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1787383620.965204:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1787383620.965215:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1787383620.965255:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1787383620.965269:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1787383620.965283:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1787383620.965310:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1787383620.965324:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1787383620.965335:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1787383620.965347:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1787383620.965356:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1787383620.965366:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1787383620.965376:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1787383620.965386:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1787383620.965395:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1787383620.965405:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1787383620.965416:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1787383620.965451:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.965599:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.965640:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004800 00000100:00100000:1.0:1787383620.965645:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004800 00000100:00100000:1.0:1787383620.965671:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383620.965677:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.965783:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004800:12345-0@lo:502:mount.lustre.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.965791:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383620.965827:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618feaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383620.965843:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.966053:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1787383620.966075:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1787383620.966094:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.966134:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.966156:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985004928 00000100:00100000:1.0:1787383620.966159:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985004928 00000100:00100000:1.0:1787383620.966176:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383620.966181:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383620.966362:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985004928:12345-0@lo:502:mount.lustre.0 Request processed in 179us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.966369:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383620.966398:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618feaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383620.966409:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985004928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787383620.966441:0:23392:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787383620.966448:0:23392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787383620.976621:0:23410:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1787383620.976639:0:23410:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff96363cd519c0) 00000020:00000080:3.0:1787383620.976661:0:23410:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1787383620.976857:0:23410:0:(tgt_mount.c:153:server_get_mount()) get mount ffff963503110800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787383620.977966:0:23410:0:(tgt_mount.c:187:server_put_mount()) put mount ffff963503110800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1787383620.977974:0:23410:0:(obd_mount.c:710:lustre_put_lsi()) put ffff963503110800 3 00010000:00080000:3.0:1787383620.978015:0:23410:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963635069000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1787383620.983418:0:23410:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1787383620.984717:0:23410:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1787383620.984789:0:23410:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787383620.984803:0:23410:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xc40acec91533000f 00000100:00080000:3.0:1787383620.984814:0:23410:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383620.984820:0:23410:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff963635069000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383620.984856:0:23410:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca50000 x1874206985005056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383620.986162:0:23410:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787383620.986222:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787383620.986226:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787383620.986229:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383620.986238:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363cd5b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383620.986256:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca50700 x1874206985005312/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383620.986267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.986270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.986272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.986275:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.986300:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.986303:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383620.986305:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383620.986307:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383620.986324:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383620.986338:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985005184:0@lo:400:kworker.0 00000100:00100000:3.0:1787383620.986412:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.986458:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985005440:0@lo:400:kworker.0 00000100:00100000:3.0:1787383620.988295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.988331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383620.988342:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985005568:0@lo:400:kworker.0 00000100:00100000:3.0:1787383620.988371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.988413:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005184 00000100:00100000:3.0:1787383620.988420:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005184 00000100:00100000:1.0:1787383620.988734:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206985005056:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383620.988793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383620.988828:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985005312:0@lo:38:kworker.0 00000100:00100000:1.0:1787383620.988868:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383620.988997:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787383620.989011:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3649:x1874206985005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383620.989041:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005440 00000100:00100000:1.0:1787383620.989047:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005440 00000100:00100000:3.0:1787383620.989071:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3649:x1874206985005184:12345-0@lo:400:kworker.0 Request processed in 62us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383620.989080:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787383620.989082:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005056 00000100:00100000:1.0:1787383620.989087:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005056 00000100:00100000:1.0:1787383620.989102:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383620.989111:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985005440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383620.989120:0:22659:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787383620.989129:0:22659:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787383620.989159:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985005440:12345-0@lo:400:kworker.0 Request processed in 50us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.989166:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383620.989179:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383620.989192:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1874206985005056:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787383620.989213:0:22661:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 654 last 0 00000020:00000080:1.0:1787383620.989253:0:22661:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xc40acec915330016 00000004:00100000:1.0:1787383620.989268:0:22661:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383620.989303:0:22661:0:(import.c:65:import_set_state_nolock()) ffff963635199000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383620.989342:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1874206985005056:12345-0@lo:38:llog_process_th.0 Request processed in 149us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.989349:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787383620.989367:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005568 00000100:00100000:1.0:1787383620.989371:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005568 00000100:00100000:1.0:1787383620.989385:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005312 00000100:00100000:1.0:1787383620.989388:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005312 00000100:00100000:1.0:1787383620.989398:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383620.989403:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985005568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383620.989436:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985005568:12345-0@lo:400:kworker.0 Request processed in 32us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383620.989442:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383620.989452:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383620.989456:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985005312:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1787383620.989499:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985005312:12345-0@lo:38:kworker.0 Request processed in 41us (630us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787383620.989505:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787383620.989541:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96363ca50000 x1874206985005056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383620.989551:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383620.989558:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787383620.989573:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787383620.989578:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787383620.989581:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963635069000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383620.989587:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1874206985005056:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787383620.989601:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383620.989605:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787383620.989608:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985005312:0@lo:38:kworker.0 00000100:00100000:1.0:1787383620.989746:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985005568:0@lo:400:kworker.0 00010000:00080000:1.0:1787383620.989757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96363ca53800 x1874206985005440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383620.989785:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985005440:0@lo:400:kworker.0 00000100:00100000:3.0:1787383620.992065:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985005184:0@lo:400:kworker.0 00000040:00080000:3.0:1787383620.997551:0:23410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:2.0:1787383620.997973:0:23392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787383620.998013:0:23392:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787383620.998033:0:23392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330001 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383620.998046:0:23392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac9400/0xc40acec91532fffa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330001 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787383620.998097:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787383620.998099:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383620.998101:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383620.998102:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383620.998103:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383620.998105:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383620.998106:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383620.998109:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383620.998110:0:23392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383620.998114:0:23392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787383620.998117:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787383620.998118:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383620.998120:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383620.998121:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383620.998122:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383620.998123:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383620.998124:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383620.998125:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383620.998127:0:23392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787383620.998155:0:23392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787383620.998173:0:23392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985005696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787383620.998236:0:23392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383620.998269:0:23392:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383620.998568:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005696 00000100:00100000:3.0:1787383620.998576:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005696 00000100:00100000:3.0:1787383620.998627:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383620.998637:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:23392:x1874206985005696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787383620.998663:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787383620.998677:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1787383621.003047:0:22639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1787383621.003575:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787383621.003594:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787383621.003745:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787383621.003750:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787383621.003790:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.003809:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ff1a expref: 18 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.003819:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.003825:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.003868:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.003882:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383621.003897:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985005824:0@lo:104: 00000100:00100000:2.0:1787383621.006830:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383621.006907:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532ff1a expref: 18 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383621.007131:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005824 00000100:00100000:1.0:1787383621.007139:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005824 00000100:00100000:1.0:1787383621.007192:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383621.007203:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985005824:12345-0@lo:104: 00010000:00010000:1.0:1787383621.007217:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.007270:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383621.007277:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985005824:12345-0@lo:104: Request processed in 77us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383621.007284:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787383621.007311:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383621.007317:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.007334:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383621.007339:0:22647:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.007347:0:22647:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383621.007353:0:22647:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383621.007358:0:22647:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383621.007389:0:22647:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.007396:0:22647:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383621.007417:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.007424:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0200/0xc40acec91532ffde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532ffe5 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.007437:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383621.007439:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383621.007441:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383621.007462:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985006080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383621.007496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383621.007539:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006080 00000100:00100000:1.0:1787383621.007545:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006080 00010000:00010000:2.0:1787383621.007723:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532ff1a expref: 19 pid: 22652 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383621.007740:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985005952:0@lo:104: 00000100:00100000:0.0:1787383621.007987:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:23392:x1874206985005696:12345-0@lo:253:mount.lustre.0 Request processed in 9279us (9677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383621.008004:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383621.008097:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383621.008132:0:22675:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383621.008151:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985005824:0@lo:104: 00000100:00100000:2.0:1787383621.008176:0:23392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:23392:1874206985005696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787383621.008187:0:23392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787383621.008190:0:23392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787383621.008192:0:23392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787383621.008193:0:23392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787383621.008194:0:23392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787383621.008196:0:23392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787383621.008197:0:23392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787383621.008199:0:23392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787383621.008201:0:23392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787383621.008202:0:23392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787383621.008214:0:23392:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787383621.008744:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985005952 00000100:00100000:0.0:1787383621.008750:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985005952 00000100:00100000:0.0:1787383621.008807:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383621.008815:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985005952:12345-0@lo:104: 00010000:00010000:0.0:1787383621.008827:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383621.008871:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383621.008876:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985005952:12345-0@lo:104: Request processed in 63us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383621.008881:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787383621.009167:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383621.009252:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383621.009261:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3649:x1874206985006080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383621.009272:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383621.009279:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.009289:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.009304:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0c00/0xc40acec91532ffe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532ffde expref: 18 pid: 22654 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383621.009318:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383621.009353:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:3649:x1874206985006080:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383621.009360:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787383621.009410:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985006080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787383621.011431:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985005952:0@lo:104: 00010000:00010000:2.0:1787383621.011459:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.011481:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383621.011486:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.011494:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:2.0:1787383621.011498:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.011507:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787383621.011520:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383621.011525:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787383621.011560:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.011566:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787383621.011579:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.011585:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636113c9800/0xc40acec91532ff1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532ff21 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.011598:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383621.011600:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383621.011602:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383621.012237:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985006208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383621.012292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383621.014214:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006208 00000100:00100000:3.0:1787383621.014225:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006208 00010000:00010000:3.0:1787383621.014257:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532ff1a expref: 17 pid: 22652 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383621.014304:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383621.014312:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:3650:x1874206985006208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383621.014325:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383621.014330:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532ff1a expref: 17 pid: 22652 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014342:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532ff1a expref: 17 pid: 22652 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014357:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0a00/0xc40acec91532ff21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532ff1a expref: 17 pid: 22652 timeout: 754 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014373:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014382:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383621.014397:0:22646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010648134s 00010000:00010000:3.0:1787383621.014401:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014409:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014416:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014422:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014433:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383621.014437:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014445:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014464:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383621.014475:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383621.014526:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:3650:x1874206985006208:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383621.014535:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787383621.017180:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.017196:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383621.017203:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9e00/0xc40acec91533001d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383621.018140:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985006208:0@lo:103:ldlm_bl.0 00000040:01000000:0.0:1787383621.019415:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787383621.019649:0:23417:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787383621.019653:0:23417:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787383621.022177:0:23418:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787383621.022350:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1787383621.023687:0:23418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383621.025700:0:23418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383621.025806:0:23418:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1787383621.030857:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874206985006336:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383621.030947:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383621.030977:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787383621.032846:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006336 00000100:00100000:1.0:1787383621.032871:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006336 00000100:00100000:1.0:1787383621.032950:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383621.032960:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1874206985006336:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1787383621.033078:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1874206985006336:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383621.033087:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:0.0:1787383621.033787:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787383621.033832:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787383621.034337:0:23392:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787383621.034346:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787383621.034387:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383621.036178:0:23392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:3.0:1787383621.036364:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874206985006336:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787383621.036402:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787383621.036447:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874206985006464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383621.036510:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383621.036538:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383621.036776:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006464 00000100:00100000:2.0:1787383621.036783:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006464 00000100:00100000:2.0:1787383621.036818:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383621.036826:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874206985006464:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787383621.036984:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874206985006464:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 158us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383621.036992:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787383621.037090:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874206985006464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787383621.037151:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23420:1874206985006592:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787383621.037182:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383621.037199:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff963606513240 going to sleep for 11 seconds 00000040:00080000:0.0:1787383621.039063:0:23392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787383621.039132:0:23392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787383621.039251:0:23392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787383621.041834:0:23392:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1787383621.044843:0:23392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1787383621.045705:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006592 00000100:00100000:1.0:1787383621.045716:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006592 00000100:00100000:1.0:1787383621.045800:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383621.045811:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1874206985006592:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787383621.045903:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1874206985006592:12345-0@lo:900:lod0001_rec0000.0 Request processed in 93us (8718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383621.045911:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787383621.046080:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff96363d132680 x1874206985006592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383637 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383621.046096:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23420:1874206985006592:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787383621.046170:0:23420:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874206985006720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787383621.046208:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383621.046239:0:23420:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605146240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383621.046270:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006720 00000100:00100000:3.0:1787383621.046281:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006720 00000100:00100000:3.0:1787383621.046323:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383621.046331:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874206985006720:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787383621.046398:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23420:x1874206985006720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383621.046405:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787383621.047856:0:23420:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d132680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23420:1874206985006720:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787383621.048841:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383621.055068:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787383621.055156:0:23420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787383621.055161:0:23420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1787383621.064685:0:23392:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787383621.064726:0:23392:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb73d8151b988 00100000:10000000:0.0:1787383621.064735:0:23392:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787383621.066289:0:23392:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787383621.066324:0:23392:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787383621.066351:0:23392:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787383621.066371:0:23392:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1787383621.073557:0:23392:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383621.074063:0:23392:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787383621.148956:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787383621.787124:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383622.049002:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787383622.184092:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787383622.811052:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383622.940812:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787383622.940820:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963503110800 from 12 10000000:01000000:3.0:1787383622.940825:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787383622.940870:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383622.940882:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383622.940891:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383622.940926:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985006848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383622.940987:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383622.941020:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963604a92c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383622.941099:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006848 00000100:00100000:0.0:1787383622.941115:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006848 00000100:00100000:0.0:1787383622.941164:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787383622.941174:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:22656:x1874206985006848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383622.941188:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383622.941202:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330024 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941233:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330024 expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941244:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330024 expref: 17 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941253:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac9c00, rc 0) 00000100:00100000:0.0:1787383622.941294:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985006848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383622.941301:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787383622.941357:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985006848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383622.941369:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941378:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383622.941426:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985006976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383622.941456:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383622.941470:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383622.941483:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985006976 00000100:00100000:0.0:1787383622.941493:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985006976 00000100:00100000:0.0:1787383622.941516:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383622.941521:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985006976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787383622.941534:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383622.941549:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383622.941552:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787383622.941634:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985006976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383622.941641:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787383622.941675:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985006976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787383622.941715:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383622.941721:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941728:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383622.941737:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383622.941739:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9635035fe000 from 12 10000000:01000000:0.0:1787383622.941742:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383622.941757:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941786:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941794:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383622.941806:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985007104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383622.941836:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383622.941848:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383622.941859:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007104 00000100:00100000:0.0:1787383622.941863:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007104 00000100:00100000:0.0:1787383622.941884:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383622.941890:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985007104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383622.941897:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383622.941904:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330032 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941930:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330032 expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941937:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330032 expref: 18 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.941944:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96363dac8c00, rc 0) 00000100:00100000:0.0:1787383622.941970:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985007104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383622.941975:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383622.942003:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985007104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383622.942012:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.942019:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383622.942054:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985007232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383622.942084:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383622.942096:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787383622.942107:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007232 00000100:00100000:0.0:1787383622.942110:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007232 00000100:00100000:0.0:1787383622.942136:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383622.942142:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985007232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787383622.942151:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787383622.942161:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787383622.942164:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787383622.942220:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985007232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383622.942227:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383622.942254:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985007232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787383622.942283:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787383622.942499:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383622.942508:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383623.068346:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383623.201025:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1787383623.835107:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383624.221134:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1787383624.858982:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383625.242868:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000001:02000400:3.0:1787383625.396057:0:23663:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787383625.885229:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787383626.235456:0:23715:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383626.235645:0:23715:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787383626.267114:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1787383626.395367:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787383626.395374:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787383626.395377:0:8:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383626.395388:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff96363cd5b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383626.395418:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e90a80 x1874206985007616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383626.395458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383626.395462:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383626.395465:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383626.395468:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383626.395490:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383626.395493:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787383626.395495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383626.395498:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383626.395637:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985007360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383626.395698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383626.395753:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985008000:0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396003:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985007488:0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396038:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383626.396076:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985007872:0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396098:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383626.396115:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383626.396121:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206985007744:0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383626.396168:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007488 00000100:00100000:2.0:1787383626.396175:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007488 00000100:00100000:2.0:1787383626.396218:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383626.396228:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3648:x1874206985007488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396273:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3648:x1874206985007488:12345-0@lo:400:kworker.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383626.396280:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383626.396309:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007360 00000100:00100000:2.0:1787383626.396312:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007360 00000100:00100000:2.0:1787383626.396328:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007872 00000100:00100000:2.0:1787383626.396338:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007872 00000100:00100000:2.0:1787383626.396353:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383626.396358:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985007360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383626.396382:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383626.396411:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985007360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383626.396418:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383626.396429:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383626.396435:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985007872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396466:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985007872:12345-0@lo:400:kworker.0 Request processed in 31us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383626.396472:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787383626.396504:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985007488:0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.396532:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985007872:0@lo:400:kworker.0 00000100:00100000:1.0:1787383626.396719:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383626.396759:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985007360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383626.396808:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007744 00000100:00100000:1.0:1787383626.396811:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007744 00000100:00100000:2.0:1787383626.398225:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008000 00000100:00100000:2.0:1787383626.398234:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008000 00000100:00100000:2.0:1787383626.398272:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383626.398291:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206985007744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.398348:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206985007744:12345-0@lo:400:kworker.0 Request processed in 59us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383626.398355:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383626.398369:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383626.398375:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985008000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383626.398405:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985008000:12345-0@lo:400:kworker.0 Request processed in 30us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383626.398424:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787383626.398460:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503e91f80 x1874206985007744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383626.398473:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206985007744:0@lo:400:kworker.0 00000100:00100000:3.0:1787383626.399265:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985007616:0@lo:38:kworker.0 00000100:00100000:3.0:1787383626.399314:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383626.399440:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985007616 00000100:00100000:2.0:1787383626.399446:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985007616 00000100:00100000:2.0:1787383626.399481:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383626.399487:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1874206985007616:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787383626.399511:0:22665:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 659 last 0 00000020:00000080:2.0:1787383626.399544:0:22665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec915330040 00000004:00100000:2.0:1787383626.399558:0:22665:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787383626.399564:0:22665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:1.0:1787383626.400180:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963503e90000 x1874206985008000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383626.400193:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985008000:0@lo:400:kworker.0 00000100:00080000:2.0:1787383626.416756:0:22665:0:(import.c:65:import_set_state_nolock()) ffff96363f98c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383626.417160:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206985007616:12345-0@lo:38:kworker.0 Request processed in 17669us (17842us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383626.417171:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787383626.417688:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787383626.417698:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787383626.417704:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787383626.417719:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363cd5b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787383626.417819:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009c70458e): req@ffff96363ca53480 x1874206985000064/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383626.417855:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985007616:0@lo:38:kworker.0 00000100:00100000:1.0:1787383626.418054:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383626.418085:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361820a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383626.418142:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985000064 00000100:00100000:3.0:1787383626.418149:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985000064 00000100:00100000:3.0:1787383626.418195:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383626.418203:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1874206985000064:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787383626.418281:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1874206985000064:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383626.418386:0:22701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1874206985000064:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1787383626.418419:0:22701:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1787383626.418458:0:22701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1874206985008128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787383626.418500:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383626.418528:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363d8d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383626.418629:0:22665:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787383626.418637:0:22665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1787383626.418966:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787383626.418984:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008128 00000100:00100000:3.0:1787383626.418988:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008128 00000100:00100000:3.0:1787383626.419004:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787383626.419009:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1874206985008128:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787383626.419109:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1874206985008128:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383626.419116:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787383626.419183:0:22701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1874206985008128:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383626.419252:0:22701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d131c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1874206985008256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787383626.419280:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383626.419310:0:22701:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635046b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383626.419427:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008256 00000100:00100000:1.0:1787383626.419432:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008256 00000100:00100000:1.0:1787383626.419453:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383626.419458:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22701:x1874206985008256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1787383626.419523:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22701:x1874206985008256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 64us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383626.419530:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383626.419555:0:22701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d131c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22701:1874206985008256:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1787383626.419598:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383626.426528:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985008384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383626.426605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383626.426822:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008384 00000100:00100000:0.0:1787383626.426829:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008384 00000100:00100000:0.0:1787383626.427058:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383626.427074:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985008384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383626.427112:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383626.427239:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985008384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383626.427250:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787383626.427312:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985008384:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787383626.429140:0:22701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787383626.429220:0:22701:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1787383626.429224:0:22701:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787383626.907220:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787383627.158264:0:23766:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383627.158672:0:23766:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383627.930981:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787383628.188370:0:23814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe0bceb7a0 00000020:00000080:3.0:1787383628.188385:0:23814:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787383628.188390:0:23814:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787383628.188398:0:23814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0bceda30 20000000:00000080:3.0:1787383628.188405:0:23814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff963605850400 uarg=0000000000000000 20000000:01000000:3.0:1787383628.188447:0:23814:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787383628.188453:0:23814:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787383628.188458:0:23814:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787383628.190382:0:23815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1787383628.190538:0:23814:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787383628.197588:0:23814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787383628.197634:0:23814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.197653:0:23814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532fee9 expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.197660:0:23814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91532ffec expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.197667:0:23814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.197710:0:23814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532ffec expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.197725:0:23814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532ffec expref: 17 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383628.197741:0:23814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d131c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874206985008512:0@lo:104: 00000100:00100000:2.0:1787383628.200089:0:23814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383628.200252:0:23814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91532fee9 expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.200265:0:23814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91532fee9 expref: 17 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383628.200278:0:23814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874206985008640:0@lo:104: 00000100:00100000:2.0:1787383628.200313:0:23814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383628.208670:0:23814:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635046b9540 going to sleep for 11 seconds 00000100:00100000:1.0:1787383628.213540:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008512 00000100:00100000:1.0:1787383628.213567:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008512 00000100:00100000:1.0:1787383628.213623:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008640 00000100:00100000:1.0:1787383628.213627:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008640 00000100:00100000:1.0:1787383628.213644:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383628.213653:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:23814:x1874206985008512:12345-0@lo:104: 00010000:00010000:1.0:1787383628.213669:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.213792:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383628.213800:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:23814:x1874206985008512:12345-0@lo:104: Request processed in 148us (13717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383628.213807:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383628.213833:0:23814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d131c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874206985008512:0@lo:104: 00000100:00100000:1.0:1787383628.213896:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383628.213914:0:22643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:23814:x1874206985008640:12345-0@lo:104: 00010000:00010000:1.0:1787383628.213922:0:22643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.213966:0:22643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787383628.213972:0:22643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:23814:x1874206985008640:12345-0@lo:104: Request processed in 58us (13658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383628.213977:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787383628.213992:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383628.213998:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214004:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383628.214008:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214015:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383628.214023:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383628.214028:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383628.214060:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214066:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383628.214084:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214100:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec91532ffec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fff3 expref: -99 pid: 23392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214112:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383628.214115:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214120:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac8e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383628.214122:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214128:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383628.214134:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383628.214138:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383628.214150:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214155:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383628.214161:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214167:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96363dac8e00/0xc40acec91532fee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91532fef0 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214179:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383628.214186:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383628.214188:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383628.214193:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383628.214205:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985008768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383628.214237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383628.214266:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787383628.214272:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985008896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383628.214291:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383628.214316:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008768 00000100:00100000:1.0:1787383628.214320:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008768 00010000:00010000:1.0:1787383628.214336:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532ffec expref: 18 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383628.214401:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985008896 00000100:00100000:1.0:1787383628.214404:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985008896 00010000:00010000:1.0:1787383628.214415:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532fee9 expref: 19 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383628.214427:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383628.214433:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:3649:x1874206985008768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383628.214442:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383628.214447:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532ffec expref: 19 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214456:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532ffec expref: 19 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214469:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c1400/0xc40acec91532fff3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532ffec expref: 19 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214491:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383628.214517:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3649:x1874206985008768:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383628.214524:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787383628.214536:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383628.214541:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:3649:x1874206985008896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383628.214548:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383628.214552:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91532fee9 expref: 17 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214561:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91532fee9 expref: 17 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214572:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214580:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214594:0:22644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214601:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214607:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214612:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214622:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383628.214626:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214633:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214641:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383628.214649:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383628.214669:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:3649:x1874206985008896:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383628.214675:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383628.214703:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985008896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383628.214710:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985008768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383628.215041:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636082a6400/0xc40acec91532fef0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91532fee9 expref: 16 pid: 22652 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383628.215058:0:23814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23814:1874206985008640:0@lo:104: 00010000:00010000:2.0:1787383628.215074:0:23814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.215082:0:23814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.215088:0:23814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383628.215094:0:23814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9200/0xc40acec915330047 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383628.252114:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383628.956055:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383629.980038:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787383630.042998:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383630.043005:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963503110800 from 13 10000000:01000000:3.0:1787383630.043010:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383630.043057:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383630.043068:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383630.043077:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383630.043100:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383630.043161:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.043203:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383630.043293:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009024 00000100:00100000:2.0:1787383630.043300:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009024 00000100:00100000:2.0:1787383630.043351:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787383630.043359:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+16:22656:x1874206985009024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383630.043371:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383630.043384:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91533004e expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.043403:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91533004e expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.043413:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533004e expref: 17 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.043421:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8400, rc 0) 00000100:00100000:2.0:1787383630.043478:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985009024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383630.043485:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787383630.043618:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383630.043630:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383630.043638:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383630.043688:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383630.043711:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.043730:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383630.043966:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009152 00000100:00100000:2.0:1787383630.043971:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009152 00000100:00100000:2.0:1787383630.044002:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787383630.044009:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985009152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383630.044123:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985009152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383630.044130:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787383630.044194:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383630.044222:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383630.044265:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.044293:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91900 going to sleep for 11 seconds 00000100:00100000:0.0:1787383630.044337:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009280 00000100:00100000:0.0:1787383630.044342:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009280 00000100:00100000:0.0:1787383630.044370:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383630.044377:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985009280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383630.044464:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985009280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383630.044470:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787383630.044538:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787383630.045265:0:23893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787383630.045481:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787383630.045501:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383630.045510:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383630.045519:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383630.045530:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383630.045532:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9635035fe000 from 13 10000000:01000000:0.0:1787383630.045534:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383630.045560:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383630.045567:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383630.045576:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383630.045594:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383630.045632:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383630.045665:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383630.045725:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009408 00000100:00100000:2.0:1787383630.045730:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009408 00000100:00100000:2.0:1787383630.045757:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787383630.045877:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+17:22656:x1874206985009408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383630.045888:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383630.045901:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91533005c expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.045921:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91533005c expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.045930:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533005c expref: 18 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.045939:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8200, rc 0) 00000100:00100000:2.0:1787383630.046546:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985009408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 780us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383630.046554:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383630.049706:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383630.049732:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383630.050092:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383630.050182:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383630.050240:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383630.050918:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655180 going to sleep for 11 seconds 00000100:00100000:1.0:1787383630.053566:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009536 00000100:00100000:1.0:1787383630.053581:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009536 00000100:00100000:1.0:1787383630.053649:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383630.053658:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985009536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383630.056954:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985009536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3288us (6704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383630.056968:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787383630.065546:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383630.065978:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383630.066057:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383630.066160:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503655180 going to sleep for 11 seconds 00000100:00100000:2.0:1787383630.075080:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009664 00000100:00100000:2.0:1787383630.075095:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009664 00000100:00100000:3.0:1787383630.079216:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787383630.079230:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985009664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383630.079397:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:22656:x1874206985009664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (13339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383630.079405:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787383630.084629:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985009664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787383630.085944:0:23895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787383630.086106:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787383630.086128:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383630.086138:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383630.086150:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383630.490906:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383620/real 1787383620] req@ffff96363d131880 x1874206985003264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383630.490935:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363d131880 x1874206985003264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383630.490946:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383620/real 1787383620] req@ffff963503e92300 x1874206985003008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383630 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383630.490957:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e92300 x1874206985003008/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383630 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383630.490975:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383630.490995:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787383630.490999:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985003264:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787383630.491005:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503f63000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787383630.491010:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787383630.491014:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985003008:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787383630.491096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383630.491101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383630.491103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383630.491107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787383630.491130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383630.491133:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787383630.491136:0:36:0:(import.c:65:import_set_state_nolock()) ffff963503f63000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383630.491141:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:3.0:1787383630.491146:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787383630.491152:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff963503f63000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383630.491168:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca50380 x1874206985010176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383630.491180:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787383630.491183:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787383630.491184:0:36:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787383630.491187:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:3.0:1787383630.491190:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787383630.491193:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96363db9f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383630.491202:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca53100 x1874206985010304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787383630.491232:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985009792:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.491334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.491365:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383630.491378:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985009920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.491403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.491430:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985010048:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.491452:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.491469:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383630.491474:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985010432:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.491647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383630.491679:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009920 00000100:00100000:3.0:1787383630.491686:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009920 00000100:00100000:3.0:1787383630.491722:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985010432 00000100:00100000:3.0:1787383630.491724:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985010432 00000100:00100000:3.0:1787383630.491743:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383630.491751:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.491826:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985009920:12345-0@lo:400:kworker.0 Request processed in 74us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383630.491834:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383630.491850:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383630.491865:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985010432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.491896:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985010432:12345-0@lo:400:kworker.0 Request processed in 40us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383630.491902:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383630.491919:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985009792 00000100:00100000:3.0:1787383630.491922:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985009792 00000100:00100000:3.0:1787383630.491942:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985010048 00000100:00100000:3.0:1787383630.491944:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985010048 00000100:00100000:3.0:1787383630.491955:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383630.491961:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206985009792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.492001:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206985009792:12345-0@lo:400:kworker.0 Request processed in 39us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383630.492007:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787383630.492018:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787383630.492023:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985010048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.492046:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985010048:12345-0@lo:400:kworker.0 Request processed in 23us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383630.492052:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787383630.492093:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96363ca53480 x1874206985010432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383630.492104:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985010432:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.492112:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985010048:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.492132:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985010176:0@lo:8:kworker.0 00000400:00000100:3.0:1787383630.492154:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985010176 offset 0 length 520: 4 00000100:00100000:3.0:1787383630.492172:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985010304:0@lo:8:kworker.0 00000400:00000100:3.0:1787383630.492187:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985010304 offset 0 length 520: 4 00010000:00080000:3.0:1787383630.492210:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96363ca52680 x1874206985009920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383630.492219:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985009920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383630.492230:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985009792:0@lo:400:kworker.0 00010000:00010000:2.0:1787383631.006925:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383631.519007:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985010688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383631.519075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383631.519112:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787383631.519119:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985010560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383631.519142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383631.519172:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985010688 00000100:00100000:2.0:1787383631.519179:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985010688 00000100:00100000:2.0:1787383631.519214:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985010560 00000100:00100000:2.0:1787383631.519217:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985010560 00000100:00100000:2.0:1787383631.519232:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383631.519239:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985010688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383631.519272:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383631.519310:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985010688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383631.519317:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787383631.519342:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383631.519349:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985010560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383631.519376:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383631.519445:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985010560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383631.519451:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383631.520762:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985010560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383631.520797:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985010688:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383631.521122:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383616/real 1787383616] req@ffff963503e91880 x1874206985001088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383631.521139:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e91880 x1874206985001088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383631.521149:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383616/real 1787383616] req@ffff963503e93480 x1874206985001216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383631.521159:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff963503e93480 x1874206985001216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383631.521171:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383631.521184:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383631.521188:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985001088:0@lo:8:kworker.0 00000100:00080000:2.0:1787383631.521192:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383631.521196:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383631.521198:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985001216:0@lo:8:kworker.0 00000100:00080000:2.0:1787383631.521246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383631.521255:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787383631.521257:0:8:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383631.521261:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:2.0:1787383631.521265:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787383631.521271:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96361122b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383631.521289:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363d131500 x1874206985010944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383631.521301:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383631.521304:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787383631.521306:0:8:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787383631.521309:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 649 00000100:00080000:2.0:1787383631.521311:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787383631.521314:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9636064d6800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383631.521326:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363d131880 x1874206985011072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383631.521343:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383631.521347:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787383631.521349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787383631.521352:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787383631.521380:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985011328:0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.521427:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383631.521463:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985010944:0@lo:8:kworker.0 00000400:00000100:2.0:1787383631.521485:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985010944 offset 0 length 520: 4 00000100:00100000:2.0:1787383631.521512:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985011072:0@lo:8:kworker.0 00000400:00000100:2.0:1787383631.521533:0:3646:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874206985011072 offset 0 length 520: 4 00000100:00100000:2.0:1787383631.521707:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985010816:0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.521737:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383631.521751:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383631.521756:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985011200:0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.521864:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383631.521906:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985010816 00000100:00100000:2.0:1787383631.521912:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985010816 00000100:00100000:2.0:1787383631.521958:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383631.521965:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3649:x1874206985010816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.522008:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:3649:x1874206985010816:12345-0@lo:400:kworker.0 Request processed in 43us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383631.522016:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787383631.522054:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985010816:0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.522233:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011328 00000100:00100000:2.0:1787383631.522237:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011328 00000100:00100000:2.0:1787383631.522260:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011200 00000100:00100000:2.0:1787383631.522262:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011200 00000100:00100000:2.0:1787383631.522279:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383631.522285:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985011328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.522323:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985011328:12345-0@lo:400:kworker.0 Request processed in 38us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383631.522330:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787383631.522341:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787383631.522346:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985011200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383631.522386:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985011200:12345-0@lo:400:kworker.0 Request processed in 38us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383631.522392:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787383631.522424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d91a300 x1874206985011328/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383631.522435:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985011328:0@lo:400:kworker.0 00010000:00080000:2.0:1787383631.522455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d919f80 x1874206985011200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383631.522463:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985011200:0@lo:400:kworker.0 00010000:00010000:1.0:1787383632.027712:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787383632.033471:0:23393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787383633.051015:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787383633.307374:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383634.075103:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787383634.673294:0:24162:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787383634.673299:0:24162:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787383634.673300:0:24162:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787383634.673405:0:24162:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9636356fc800 00000020:01000004:2.0:1787383634.673421:0:24162:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787383634.673433:0:24162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787383634.673447:0:24162:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9635045919c0) 00000020:00000080:2.0:1787383634.673462:0:24162:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787383634.768494:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787383634.773465:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787383634.773854:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787383634.774226:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787383634.774684:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787383634.775286:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787383634.775631:0:24162:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1787383634.779937:0:24162:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787383634.780154:0:24162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787383634.780167:0:24162:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787383634.780179:0:24162:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc40acec915330071 00000020:01000004:2.0:1787383634.780184:0:24162:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787383634.780205:0:24162:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787383634.780208:0:24162:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787383634.780214:0:24162:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787383634.780219:0:24162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787383634.780230:0:24162:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff963504594d40) 00000020:00000080:2.0:1787383634.780253:0:24162:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787383634.786276:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787383634.787852:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787383634.787868:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787383634.798496:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787383634.798510:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787383634.808149:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787383634.808167:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787383634.812541:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383634.812710:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383634.812723:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787383634.816957:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383634.816970:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787383634.832231:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787383634.832444:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787383634.832451:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787383634.834683:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787383634.834694:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787383634.839583:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787383634.839596:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787383634.842962:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383634.843128:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383634.843134:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787383634.847237:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383634.847252:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787383634.885050:0:24162:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787383634.885225:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787383634.885232:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787383634.886342:0:24162:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787383634.886352:0:24162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787383634.886752:0:24162:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787383634.887039:0:24162:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787383634.887046:0:24162:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787383634.900569:0:24162:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787383634.900609:0:24162:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.102@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787383634.900614:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787383634.900616:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383634.900617:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383634.900619:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383634.900620:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383634.900621:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383634.900623:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383634.900624:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383634.900626:0:24162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383634.900629:0:24162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787383634.900631:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787383634.900633:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383634.900634:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383634.900635:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383634.900636:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383634.900637:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383634.900638:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383634.900639:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383634.900640:0:24162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787383634.900665:0:24162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787383634.900684:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011456:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787383634.900760:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383634.902036:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620973240 going to sleep for 11 seconds 00000100:00100000:3.0:1787383634.904279:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011456 00000100:00100000:3.0:1787383634.904293:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011456 00000100:00100000:3.0:1787383634.904362:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787383634.904372:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:24162:x1874206985011456:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787383634.904407:0:22653:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787383634.904410:0:22653:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787383634.904414:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787383634.905072:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:24162:x1874206985011456:12345-0@lo:253:mount.lustre.0 Request processed in 699us (4309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383634.905082:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787383634.905179:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787383634.905193:0:24162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787383634.905196:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787383634.905198:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787383634.905199:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787383634.905200:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787383634.905202:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787383634.905203:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787383634.905205:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787383634.905206:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787383634.905208:0:24162:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787383634.905233:0:24162:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9636356fc800 from lustre-OST0000 10000000:01000000:1.0:1787383634.905260:0:24162:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787383634.905263:0:24162:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383634.905270:0:24162:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636352c99c0 local copy 00010000:00010000:1.0:1787383634.905280:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383634.905376:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383634.905412:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383634.905448:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620973f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383634.905502:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011584 00000100:00100000:2.0:1787383634.905508:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011584 00000100:00100000:2.0:1787383634.905549:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787383634.905557:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:24162:x1874206985011584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383634.905624:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:24162:x1874206985011584:12345-0@lo:501:mount.lustre.0 Request processed in 67us (211us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383634.905631:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787383634.905742:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011584:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787383634.905757:0:24162:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787383634.905807:0:24162:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787383634.905814:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383634.905822:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383634.905878:0:24162:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9636356fc800 10000000:01000000:1.0:1787383634.905882:0:24162:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383634.905888:0:24162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787383634.905890:0:24162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383634.905894:0:24162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787383634.905897:0:24162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787383634.905920:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383634.905928:0:24162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383634.905937:0:24162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383634.905949:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011712:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383634.905974:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383634.906001:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620973f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383634.906350:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011712 00000100:00100000:3.0:1787383634.906356:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011712 00000100:00100000:3.0:1787383634.906390:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787383634.906396:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+18:24162:x1874206985011712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383634.906411:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383634.906423:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c1000/0xc40acec915330086 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91533007f expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.906443:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c1000/0xc40acec915330086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91533007f expref: 19 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.906454:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c1000/0xc40acec915330086 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533007f expref: 19 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.906462:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1000, rc 0) 00000100:00100000:3.0:1787383634.906500:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985011712:12345-0@lo:101:mount.lustre.0 Request processed in 104us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383634.906506:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787383634.906574:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011712:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383634.906586:0:24162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330086 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383634.906594:0:24162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330086 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383634.908701:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1787383634.910105:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787383634.913411:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787383634.913469:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787383634.913486:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787383634.913498:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787383634.913509:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787383634.913520:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787383634.913533:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787383634.913547:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787383634.913561:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787383634.913573:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787383634.913585:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787383634.913599:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787383634.913642:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787383634.913649:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787383634.913756:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383634.914002:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383634.914076:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383634.916073:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011840 00000100:00100000:1.0:1787383634.916086:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011840 00000100:00100000:2.0:1787383634.916275:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787383634.916285:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985011840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383634.916517:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985011840:12345-0@lo:501:mount.lustre.0 Request processed in 233us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383634.916526:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787383634.916624:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383634.916674:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383634.916720:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.916894:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610d41c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383634.917047:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985011968 00000100:00100000:2.0:1787383634.917051:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985011968 00000100:00100000:2.0:1787383634.917083:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787383634.917090:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985011968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383634.918169:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985011968:12345-0@lo:503:mount.lustre.0 Request processed in 1074us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383634.918178:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787383634.918342:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985011968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383634.919210:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383634.919314:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.919365:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.919451:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610d41c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383634.919489:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012096 00000100:00100000:3.0:1787383634.919496:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012096 00000100:00100000:3.0:1787383634.919573:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787383634.919582:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985012096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383634.920198:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985012096:12345-0@lo:502:mount.lustre.0 Request processed in 615us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383634.920206:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787383634.920293:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383634.920572:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787383634.920602:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787383634.920614:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787383634.920623:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787383634.920633:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787383634.920643:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787383634.920653:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787383634.920665:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787383634.920676:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1787383634.920688:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1787383634.920701:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1787383634.920713:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1787383634.920737:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.920813:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.921091:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963610d41c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787383634.921159:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012224 00000100:00100000:2.0:1787383634.921166:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012224 00000100:00100000:2.0:1787383634.921196:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787383634.921202:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985012224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383634.921337:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985012224:12345-0@lo:502:mount.lustre.0 Request processed in 133us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383634.921343:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787383634.921444:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383634.921488:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1787383634.921496:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787383634.922317:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787383634.922326:0:24179:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787383634.922332:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.922334:0:24179:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787383634.922339:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787383634.922353:0:24179:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff96363cd50000) 00000020:00000080:3.0:1787383634.922385:0:24179:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787383634.922393:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787383634.922468:0:24179:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9636356fc800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787383634.922478:0:24179:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787383634.922485:0:24179:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc40acec915330094 00010000:00010000:2.0:1787383634.926330:0:24179:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787383634.927065:0:24179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1787383634.933556:0:24179:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787383634.937995:0:24179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787383634.938008:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383634.938015:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.938017:0:24179:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787383634.938020:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787383634.938022:0:24179:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787383634.938024:0:24179:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787383634.938025:0:24179:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787383634.938027:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787383634.938029:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.938030:0:24179:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787383634.938032:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383634.938035:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.938036:0:24179:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787383634.938038:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787383634.938040:0:24179:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787383634.938042:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383634.938044:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.938045:0:24179:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787383634.938047:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787383634.938049:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.938051:0:24179:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787383634.938053:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787383634.938081:0:24179:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787383634.938084:0:24179:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787383634.938085:0:24179:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787383634.938088:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1787383634.943890:0:24162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787383634.943934:0:24162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787383634.943954:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330086 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383634.943966:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a6000/0xc40acec91533007f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330086 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383634.943973:0:24162:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636356fc800 from 1 10000000:01000000:0.0:1787383634.943976:0:24162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383634.944008:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383634.944023:0:24162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383634.944034:0:24162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383634.944057:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383634.944119:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.944156:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360534f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383634.946031:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012352 00000100:00100000:2.0:1787383634.946044:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012352 00000100:00100000:2.0:1787383634.946133:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787383634.946144:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:24162:x1874206985012352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383634.946159:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383634.946181:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91533009b expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383634.946207:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91533009b expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383634.946218:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533009b expref: 20 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383634.946228:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8600, rc 0) 00000100:00100000:2.0:1787383634.946299:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012352:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383634.946306:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787383634.946381:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383634.946397:0:24162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383634.946405:0:24162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383634.950568:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787383634.950907:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787383634.951067:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787383634.951091:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787383634.951112:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787383634.951124:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787383634.951135:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787383634.951145:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787383634.951156:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787383634.951169:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787383634.951182:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787383634.951196:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787383634.951208:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787383634.951222:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787383634.951227:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787383634.951297:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383634.951359:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383634.954007:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.954187:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012480 00000100:00100000:0.0:1787383634.954195:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012480 00000100:00100000:0.0:1787383634.954239:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787383634.954246:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383634.954379:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012480:12345-0@lo:501:mount.lustre.0 Request processed in 133us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.954386:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787383634.958092:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383634.958155:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383634.958231:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383634.958264:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.958319:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012608 00000100:00100000:0.0:1787383634.958326:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012608 00000100:00100000:0.0:1787383634.958363:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787383634.958372:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383634.958481:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012608:12345-0@lo:503:mount.lustre.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.958488:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787383634.958628:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012608:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787383634.959090:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787383634.959154:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383634.959192:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383634.959219:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.959407:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012736 00000100:00100000:0.0:1787383634.959411:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012736 00000100:00100000:0.0:1787383634.959435:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787383634.959447:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963618030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.959523:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963618030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012736:12345-0@lo:502:mount.lustre.0 Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.959530:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787383634.959632:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383634.959834:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787383634.959956:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787383634.959989:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787383634.960012:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787383634.960026:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787383634.960038:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787383634.960049:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787383634.960058:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787383634.960068:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787383634.960079:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787383634.960091:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787383634.960112:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383634.960147:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383634.960176:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.960216:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012864 00000100:00100000:0.0:1787383634.960220:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012864 00000100:00100000:0.0:1787383634.960250:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787383634.960255:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963618031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.960320:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963618031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012864:12345-0@lo:502:mount.lustre.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.960326:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787383634.960421:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787383634.960455:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787383634.960463:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787383634.961137:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383634.961156:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961159:0:24183:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383634.961166:0:24183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9636356fc800 00000020:00000080:0.0:1787383634.961170:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383634.961177:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383634.961180:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961181:0:24183:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383634.961184:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383634.961187:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961188:0:24183:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383634.961191:0:24183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9636356fc800 00000020:00000080:0.0:1787383634.961193:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383634.961247:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383634.961250:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961251:0:24183:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383634.961253:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383634.961256:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961257:0:24183:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383634.961267:0:24183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9636356fc800 00000020:00000080:0.0:1787383634.961269:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383634.961286:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383634.961288:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961290:0:24183:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383634.961292:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383634.961294:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961295:0:24183:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383634.961298:0:24183:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9636356fc800 00000020:00000080:0.0:1787383634.961299:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383634.961318:0:24183:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383634.961320:0:24183:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383634.961322:0:24183:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787383634.961324:0:24183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787383634.975162:0:24162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787383634.975207:0:24162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383634.975237:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.975250:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383634.975308:0:24162:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787383634.975311:0:24162:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9636356fc800 10000000:01000000:3.0:1787383634.975314:0:24162:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9636356fc800 10000000:01000000:3.0:1787383634.975318:0:24162:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787383634.975324:0:24162:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9636356fc800 from 1 10000000:01000000:3.0:1787383634.975327:0:24162:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787383634.975362:0:24162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.975383:0:24162:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.975393:0:24162:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383634.975415:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787383634.975476:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383634.975509:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff96361831b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.975958:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985012992 00000100:00100000:0.0:1787383634.975967:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985012992 00000100:00100000:0.0:1787383634.976017:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787383634.976027:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:24162:x1874206985012992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383634.976039:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383634.976052:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636013fc400/0xc40acec9153300b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec9153300a9 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383634.976076:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636013fc400/0xc40acec9153300b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec9153300a9 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383634.976087:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636013fc400/0xc40acec9153300b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec9153300a9 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383634.976095:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636013fc400, rc 0) 00000100:00100000:0.0:1787383634.976140:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985012992:12345-0@lo:101:mount.lustre.0 Request processed in 115us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.976156:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787383634.977012:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985012992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383634.977032:0:24162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300b0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383634.977042:0:24162:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec9153300b0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383634.993858:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787383634.994136:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383634.994331:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787383634.994357:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787383634.994370:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787383634.994383:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787383634.994396:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787383634.994408:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787383634.994420:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787383634.994432:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787383634.994443:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787383634.994455:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787383634.994468:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787383634.994480:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787383634.994494:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787383634.994507:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787383634.994534:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787383634.994549:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787383634.994562:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787383634.994575:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787383634.994589:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787383634.994602:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787383634.994614:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787383634.994626:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787383634.994638:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787383634.994650:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787383634.994661:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787383634.994671:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787383634.994682:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787383634.994693:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787383634.994716:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787383634.994728:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787383634.994751:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787383634.994793:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787383634.994812:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787383634.994841:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787383634.994860:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787383634.994874:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787383634.994888:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787383634.994900:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787383634.994913:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787383634.994925:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787383634.994938:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787383634.994950:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787383634.994964:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787383634.994977:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787383634.994991:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787383634.995004:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787383634.995032:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787383634.995048:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787383634.995156:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787383634.995176:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787383634.995194:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787383634.995198:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787383634.995285:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383634.995347:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.995380:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636350946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383634.995462:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013120 00000100:00100000:1.0:1787383634.995470:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013120 00000100:00100000:1.0:1787383634.995521:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787383634.995530:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787383634.995645:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013120:12345-0@lo:501:mount.lustre.0 Request processed in 116us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383634.995653:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787383634.996499:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383634.996536:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013248:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383634.996582:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.996623:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636350946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.996815:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013248 00000100:00100000:0.0:1787383634.996820:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013248 00000100:00100000:0.0:1787383634.996873:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787383634.996881:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383634.996970:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013248:12345-0@lo:503:mount.lustre.0 Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.996977:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787383634.997017:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383634.997359:0:24162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383634.997421:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.997455:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.997475:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636350946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.997488:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013376 00000100:00100000:0.0:1787383634.997491:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013376 00000100:00100000:0.0:1787383634.997512:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787383634.997517:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.997588:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013376:12345-0@lo:502:mount.lustre.0 Request processed in 69us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.997595:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787383634.997630:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383634.997795:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787383634.997817:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787383634.997842:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787383634.997855:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787383634.997866:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787383634.997876:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787383634.997897:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787383634.997908:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787383634.997931:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787383634.997943:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787383634.997953:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787383634.997963:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787383634.997974:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787383634.997984:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787383634.997995:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787383634.998005:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787383634.998015:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787383634.998025:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787383634.998036:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787383634.998046:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787383634.998056:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787383634.998067:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787383634.998078:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787383634.998092:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787383634.998118:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787383634.998134:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787383634.998151:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787383634.998164:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787383634.998177:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787383634.998188:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787383634.998199:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787383634.998212:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787383634.998225:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787383634.998236:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787383634.998248:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787383634.998261:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787383634.998276:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787383634.998290:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787383634.998304:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787383634.998331:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787383634.998357:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787383634.998372:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787383634.998384:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787383634.998395:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787383634.998407:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787383634.998420:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787383634.998434:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787383634.998445:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787383634.998473:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.998508:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.998536:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013504 00000100:00100000:0.0:1787383634.998540:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013504 00000100:00100000:0.0:1787383634.998566:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787383634.998573:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.998637:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013504:12345-0@lo:502:mount.lustre.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.998643:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787383634.998677:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636350946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.998689:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383634.998838:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1787383634.998859:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1787383634.998876:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.998907:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383634.998925:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013632 00000100:00100000:0.0:1787383634.998928:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013632 00000100:00100000:0.0:1787383634.998946:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787383634.998951:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013632:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383634.999005:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985013632:12345-0@lo:502:mount.lustre.0 Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383634.999011:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787383634.999042:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636350946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383634.999053:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985013632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383634.999083:0:24162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787383634.999090:0:24162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787383635.009854:0:24188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787383635.009872:0:24188:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff963627ae19c0) 00000020:00000080:3.0:1787383635.009895:0:24188:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787383635.010079:0:24188:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9636356fc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787383635.010083:0:24188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9636356fc800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787383635.010086:0:24188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636356fc800 3 00010000:00080000:3.0:1787383635.010117:0:24188:0:(ldlm_lib.c:102:import_set_conn()) imp ffff96363506b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:3.0:1787383635.011699:0:24188:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787383635.011815:0:24188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787383635.011867:0:24188:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787383635.011879:0:24188:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc40acec9153300be 00000100:00080000:3.0:1787383635.011889:0:24188:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787383635.011901:0:24188:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff96363506b000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:3.0:1787383635.011938:0:24188:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363ca50e00 x1874206985013760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787383635.011963:0:24188:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787383635.012498:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206985013760:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787383635.012621:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383635.012690:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013760 00000100:00100000:2.0:1787383635.012698:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013760 00000100:00100000:2.0:1787383635.012725:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383635.012732:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206985013760:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787383635.012753:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:2.0:1787383635.012811:0:22660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc40acec9153300c5 00000004:00100000:2.0:1787383635.012837:0:22660:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787383635.012866:0:22660:0:(import.c:65:import_set_state_nolock()) ffff963503417800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383635.012913:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1874206985013760:12345-0@lo:38:llog_process_th.0 Request processed in 180us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383635.012920:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787383635.012957:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96363ca50e00 x1874206985013760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383635.012977:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787383635.012985:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787383635.012991:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787383635.012995:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787383635.012997:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363506b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787383635.013003:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1874206985013760:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1787383635.017037:0:24188:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787383635.017054:0:24188:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9635037019c0) 00000020:00000080:2.0:1787383635.017079:0:24188:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1787383635.017214:0:24188:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9636356fc800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383635.017219:0:24188:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9636356fc800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787383635.017221:0:24188:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9636356fc800 3 00010000:00080000:2.0:1787383635.017249:0:24188:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963503414800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.102@tcp at head 00010000:00010000:2.0:1787383635.018912:0:24188:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787383635.019008:0:24188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787383635.019050:0:24188:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787383635.019063:0:24188:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xc40acec9153300d3 00000100:00080000:2.0:1787383635.019074:0:24188:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787383635.019080:0:24188:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff963503414800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:2.0:1787383635.019117:0:24188:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96362d919180 x1874206985013888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787383635.019145:0:24188:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787383635.019839:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206985013888:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787383635.019908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383635.020022:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985013888 00000100:00100000:3.0:1787383635.020029:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985013888 00000100:00100000:3.0:1787383635.020064:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383635.020071:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1874206985013888:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787383635.020097:0:23412:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 668 last 0 00000020:00000080:3.0:1787383635.020129:0:23412:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xc40acec9153300da 00000004:00100000:3.0:1787383635.020145:0:23412:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787383635.020197:0:23412:0:(import.c:65:import_set_state_nolock()) ffff963503070000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383635.020250:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1874206985013888:12345-0@lo:38:llog_process_th.0 Request processed in 178us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383635.020257:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787383635.020297:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96362d919180 x1874206985013888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383635.020308:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383635.020315:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787383635.020322:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787383635.020326:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787383635.020328:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503414800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787383635.020333:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1874206985013888:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787383635.026433:0:24188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00080000:1.0:1787383635.028232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028238:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028241:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028244:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028275:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028291:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028305:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028311:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383635.028313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383635.028315:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383635.029730:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985014400:0@lo:400:kworker.0 00000100:00100000:3.0:1787383635.029850:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383635.029881:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383635.029887:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985014016:0@lo:400:kworker.0 00000100:00100000:3.0:1787383635.029910:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383635.030000:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985014144:0@lo:400:kworker.0 00000100:00100000:2.0:1787383635.030026:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383635.030090:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383635.030097:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985014272:0@lo:400:kworker.0 00000100:00100000:2.0:1787383635.030117:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1787383635.030329:0:24162:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787383635.030369:0:24162:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787383635.030387:0:24162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300b0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.030398:0:24162:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1c00/0xc40acec9153300a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300b0 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787383635.030443:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787383635.030445:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383635.030446:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383635.030447:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383635.030448:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383635.030449:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383635.030451:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383635.030452:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383635.030453:0:24162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383635.030457:0:24162:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787383635.030459:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787383635.030460:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383635.030461:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383635.030463:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383635.030464:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383635.030465:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383635.030465:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383635.030466:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383635.030471:0:24162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787383635.030491:0:24162:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787383635.030502:0:24162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985014528:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787383635.030533:0:24162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383635.030556:0:24162:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635094180 going to sleep for 11 seconds 00000100:00100000:0.0:1787383635.030574:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014528 00000100:00100000:0.0:1787383635.030579:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014528 00000100:00100000:0.0:1787383635.030614:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787383635.030621:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985014528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383635.030643:0:22653:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787383635.030655:0:22653:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787383635.031214:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014400 00000100:00100000:3.0:1787383635.031220:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014400 00000100:00100000:3.0:1787383635.031255:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014144 00000100:00100000:3.0:1787383635.031258:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014144 00000100:00100000:3.0:1787383635.031284:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383635.031291:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985014400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383635.031342:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985014400:12345-0@lo:400:kworker.0 Request processed in 51us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383635.031349:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383635.031363:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787383635.031370:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985014144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383635.031405:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985014144:12345-0@lo:400:kworker.0 Request processed in 35us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383635.031411:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787383635.031444:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff96363692a300 x1874206985014400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383635.031458:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985014400:0@lo:400:kworker.0 00000100:00100000:2.0:1787383635.031660:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014016 00000100:00100000:2.0:1787383635.031665:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014016 00000100:00100000:2.0:1787383635.031695:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014272 00000100:00100000:2.0:1787383635.031698:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014272 00000100:00100000:2.0:1787383635.031711:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383635.031716:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985014016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383635.031817:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985014016:12345-0@lo:400:kworker.0 Request processed in 100us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383635.031824:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787383635.031847:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383635.031854:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985014272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383635.031895:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985014272:12345-0@lo:400:kworker.0 Request processed in 42us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383635.031900:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787383635.031931:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985014272:0@lo:400:kworker.0 00010000:00080000:2.0:1787383635.031944:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff963636928a80 x1874206985014144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383635.031952:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985014144:0@lo:400:kworker.0 00000100:00100000:1.0:1787383635.032481:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985014016:0@lo:400:kworker.0 20000000:01000000:2.0:1787383635.038175:0:22653:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787383635.038201:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787383635.038399:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383635.038405:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383635.038427:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.038447:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330024 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.038456:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330032 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.038463:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.038500:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec915330032 expref: 21 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.038513:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec915330032 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383635.038607:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985014656:0@lo:104: 00000100:00100000:0.0:1787383635.038667:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383635.038708:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec915330024 expref: 21 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383635.038717:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec915330024 expref: 21 pid: 22653 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383635.038726:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985014784:0@lo:104: 00000100:00100000:0.0:1787383635.038747:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383635.038809:0:22675:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635094000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383635.038820:0:22642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787383635.038846:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014656 00000100:00100000:1.0:1787383635.038853:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014656 00000100:00100000:1.0:1787383635.038897:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014784 00000100:00100000:1.0:1787383635.038900:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014784 00000100:00100000:1.0:1787383635.038914:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383635.038922:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:22675:x1874206985014656:12345-0@lo:104: 00010000:00010000:1.0:1787383635.038934:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.038990:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383635.038996:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:22675:x1874206985014656:12345-0@lo:104: Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383635.039002:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383635.039021:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383635.039026:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985014784:12345-0@lo:104: 00010000:00010000:1.0:1787383635.039043:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039076:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787383635.039081:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985014784:12345-0@lo:104: Request processed in 55us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383635.039087:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787383635.039127:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383635.039133:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039145:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96363dac9e00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383635.039149:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039156:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383635.039164:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383635.039169:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787383635.039195:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039202:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383635.039220:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039228:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff96363dac9e00/0xc40acec915330032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330039 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383635.039238:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24162:x1874206985014528:12345-0@lo:253:mount.lustre.0 Request processed in 8617us (8703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383635.039245:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1787383635.039245:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383635.039248:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039253:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383635.039256:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039263:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383635.039269:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383635.039273:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1787383635.039281:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985014912:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383635.039285:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039291:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383635.039304:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383635.039306:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787383635.039311:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c0a00/0xc40acec915330024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91533002b expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.039323:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383635.039324:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383635.039326:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383635.039331:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383635.039890:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985014912 00000100:00100000:2.0:1787383635.039897:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985014912 00010000:00010000:2.0:1787383635.039916:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec915330032 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383635.039944:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383635.039950:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3648:x1874206985014912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383635.039961:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383635.039966:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec915330032 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383635.039977:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec915330032 expref: 21 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383635.039992:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787383635.040022:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3648:x1874206985014912:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383635.040027:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383635.040046:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383635.040054:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985015040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383635.040192:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac8c00/0xc40acec915330039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec915330032 expref: 20 pid: 22654 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383635.040205:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985014656:0@lo:104: 00000100:00100000:0.0:1787383635.040215:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985014784:0@lo:104: 00010000:00010000:0.0:1787383635.040231:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383635.040258:0:24162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24162:1874206985014528:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787383635.040266:0:24162:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787383635.040269:0:24162:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787383635.040271:0:24162:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787383635.040272:0:24162:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787383635.040273:0:24162:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787383635.040274:0:24162:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787383635.040275:0:24162:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787383635.040277:0:24162:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787383635.040286:0:24162:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787383635.040287:0:24162:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787383635.040299:0:24162:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1787383635.040597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383635.040651:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985014912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383635.040808:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015040 00000100:00100000:1.0:1787383635.040813:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015040 00010000:00010000:1.0:1787383635.040839:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec915330024 expref: 20 pid: 22653 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383635.040927:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383635.040934:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963604962850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:3650:x1874206985015040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383635.040943:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383635.040947:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec915330024 expref: 20 pid: 22653 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.040955:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec915330024 expref: 20 pid: 22653 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.040966:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff96363dac9c00/0xc40acec91533002b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec915330024 expref: 20 pid: 22653 timeout: 768 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.040977:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.040985:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787383635.041089:0:22644:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010648134s 00010000:00010000:1.0:1787383635.041094:0:22644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041101:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041108:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041121:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041128:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383635.041132:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041140:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041166:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041176:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383635.041211:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963604962850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:3650:x1874206985015040:12345-0@lo:103:ldlm_bl.0 Request processed in 278us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383635.041217:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787383635.041313:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041322:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383635.041328:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636013fd200/0xc40acec9153300e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383635.041431:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985015040:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787383635.048809:0:24162:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787383635.052949:0:24162:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787383635.052969:0:24162:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787383635.053018:0:24162:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787383635.053065:0:24162:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787383635.053098:0:24162:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787383635.053120:0:24162:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787383635.054008:0:24162:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383635.058142:0:24162:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383635.100404:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787383635.885730:0:24241:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383635.885983:0:24241:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787383636.123187:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383636.635306:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985015168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383636.635386:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383636.635599:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015168 00000100:00100000:2.0:1787383636.635607:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015168 00000100:00100000:2.0:1787383636.635660:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383636.635669:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985015168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383636.635702:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383636.635830:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985015168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383636.635837:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787383636.635880:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985015168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383636.636256:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985015296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383636.636294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1787383636.636389:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383636.636393:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963503110800 from 13 10000000:01000000:0.0:1787383636.636397:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383636.636432:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383636.636444:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383636.636454:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383636.636471:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383636.636506:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383636.636537:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360391ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383636.636910:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015296 00000100:00100000:3.0:1787383636.636916:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015296 00000100:00100000:3.0:1787383636.636953:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383636.636968:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985015296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787383636.636992:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787383636.637035:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985015296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383636.638277:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383636.641747:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015424 00000100:00100000:1.0:1787383636.641762:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015424 00000100:00100000:1.0:1787383636.641873:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787383636.641883:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+19:22656:x1874206985015424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383636.641899:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383636.641919:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec9153300e8 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383636.641947:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec9153300e8 expref: 20 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383636.641958:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec9153300e8 expref: 20 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383636.641967:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a7600, rc 0) 00000100:00100000:1.0:1787383636.642288:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:22656:x1874206985015424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 405us (5779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383636.642296:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787383636.642359:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985015296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383636.643453:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383636.643476:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383636.643488:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383636.643554:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787383636.643613:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383636.643651:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360391ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383636.643844:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015552 00000100:00100000:2.0:1787383636.643852:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015552 00000100:00100000:2.0:1787383636.643898:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787383636.643908:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:22656:x1874206985015552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383636.643926:0:22653:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383636.643942:0:22653:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383636.643944:0:22653:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787383636.644037:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:22656:x1874206985015552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383636.644083:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787383636.644152:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:2.0:1787383636.644258:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1787383636.644314:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383636.644324:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383636.644333:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383636.644336:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9635035fe000 from 13 10000000:01000000:0.0:1787383636.644338:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383636.644361:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383636.644369:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383636.644378:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383636.644390:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383636.644416:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383636.644448:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff96360391ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383636.644517:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015680 00000100:00100000:1.0:1787383636.644523:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015680 00000100:00100000:1.0:1787383636.644557:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787383636.644564:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:22656:x1874206985015680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383636.644573:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383636.644584:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec9153300f6 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383636.644604:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec9153300f6 expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383636.644621:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec9153300f6 expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383636.644630:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a6400, rc 0) 00000100:00100000:1.0:1787383636.644671:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985015680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383636.644677:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787383636.644841:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383636.644854:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383636.644869:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383636.644912:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d91bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787383636.644944:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383636.644963:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635094b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383636.645011:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015808 00000100:00100000:1.0:1787383636.645017:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015808 00000100:00100000:2.0:1787383636.645341:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383636.645350:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985015808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383636.645363:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383636.645376:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383636.645379:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787383636.645463:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985015808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383636.645471:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787383636.645502:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d91bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985015808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787383636.645562:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787383636.645569:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383636.645577:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383637.147397:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383638.171002:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383638.491452:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383639.195504:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787383640.219062:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383640.219069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383640.219072:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383640.219075:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383640.219092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383640.219095:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383640.219098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383640.219100:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787383640.219148:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985016320:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219266:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787383640.219273:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985015936:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219316:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219336:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985016448:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219374:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219405:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985016064:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219429:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219444:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985016576:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219465:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219483:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787383640.219488:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985016192:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219507:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219522:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206985016704:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219541:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383640.219568:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016320 00000100:00100000:1.0:1787383640.219575:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016320 00000100:00100000:1.0:1787383640.219609:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016064 00000100:00100000:1.0:1787383640.219611:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016064 00000100:00100000:1.0:1787383640.219625:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383640.219633:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219684:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985016320:12345-0@lo:400:kworker.0 Request processed in 51us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383640.219691:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383640.219707:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383640.219714:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985016064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219744:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985016064:12345-0@lo:400:kworker.0 Request processed in 31us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383640.219759:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383640.219818:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016448 00000100:00100000:1.0:1787383640.219822:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016448 00000100:00100000:1.0:1787383640.219840:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016576 00000100:00100000:1.0:1787383640.219843:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016576 00000100:00100000:1.0:1787383640.219868:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016192 00000100:00100000:1.0:1787383640.219871:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016192 00000100:00100000:1.0:1787383640.219881:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016704 00000100:00100000:1.0:1787383640.219883:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016704 00000100:00100000:1.0:1787383640.219897:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383640.219903:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985016448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219933:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985016448:12345-0@lo:400:kworker.0 Request processed in 30us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383640.219939:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383640.219950:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383640.219956:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985016576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.219981:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985016576:12345-0@lo:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383640.219987:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383640.219996:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383640.220001:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.220039:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985016192:12345-0@lo:400:kworker.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383640.220045:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383640.220056:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383640.220061:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206985016704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.220095:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206985016704:12345-0@lo:400:kworker.0 Request processed in 34us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383640.220100:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787383640.220142:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963636928e00 x1874206985016192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383640.220156:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985016192:0@lo:400:kworker.0 00010000:00080000:1.0:1787383640.220167:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363692b100 x1874206985016704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383640.220174:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206985016704:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.220183:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985016064:0@lo:400:kworker.0 00010000:00080000:1.0:1787383640.220190:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963636928a80 x1874206985016576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383640.220197:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985016576:0@lo:400:kworker.0 00010000:00080000:1.0:1787383640.220226:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963636929c00 x1874206985016448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383640.220234:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985016448:0@lo:400:kworker.0 00000100:00100000:1.0:1787383640.220242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985016320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383640.220391:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985015936 00000100:00100000:2.0:1787383640.220396:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985015936 00000100:00100000:2.0:1787383640.220431:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787383640.220444:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3647:x1874206985015936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383640.220485:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3647:x1874206985015936:12345-0@lo:400:kworker.0 Request processed in 42us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383640.220492:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787383640.220531:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985015936:0@lo:400:kworker.0 00000100:00080000:1.0:1787383640.225507:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383640.225516:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787383640.225968:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787383641.038433:0:24532:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787383641.247352:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383641.756211:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985016832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383641.756295:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383641.756454:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383641.757190:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985016960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383641.757230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383641.757282:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016832 00000100:00100000:2.0:1787383641.757290:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985016960 00000100:00100000:0.0:1787383641.757290:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016832 00000100:00100000:2.0:1787383641.757298:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985016960 00000100:00100000:0.0:1787383641.757358:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383641.757367:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985016832:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383641.757393:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787383641.757402:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985016960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383641.757414:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000004:00000024:2.0:1787383641.757425:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787383641.757472:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985016832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383641.757480:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383641.757539:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985016832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383641.757546:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985016960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383641.757554:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787383641.757571:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985016960:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1787383642.003361:0:24585:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383642.004549:0:24585:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787383642.267749:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787383642.849983:0:24635:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787383642.850212:0:24635:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787383643.297631:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383643.547729:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383644.316625:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383645.274928:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383630/real 1787383630] req@ffff96363ca50380 x1874206985010176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383645 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383645.274962:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363ca50380 x1874206985010176/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383645 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383645.274996:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383630/real 1787383630] req@ffff96363ca53100 x1874206985010304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383645 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383645.275009:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363ca53100 x1874206985010304/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383645 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787383645.275030:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503f63000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383645.275056:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383645.275060:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985010176:0@lo:8:kworker.0 00000100:00080000:2.0:1787383645.275067:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787383645.275072:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787383645.275074:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985010304:0@lo:8:kworker.0 00000100:00080000:1.0:1787383645.275235:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383645.275240:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383645.275243:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383645.275246:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383645.275277:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383645.275281:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787383645.275283:0:13975:0:(import.c:65:import_set_state_nolock()) ffff963503f63000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383645.275287:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 663 00000100:00080000:1.0:1787383645.275292:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787383645.275298:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff963503f63000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383645.275317:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635031f1180 x1874206985017600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787383645.275330:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383645.275333:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787383645.275335:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787383645.275337:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 663 00000100:00080000:1.0:1787383645.275339:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787383645.275343:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96363db9f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383645.275353:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635031f2d80 x1874206985017728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383645.275394:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985017472:0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.275457:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383645.275512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787383645.275526:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206985017344:0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.275554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383645.275572:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206985018112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.275591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383645.275618:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017472 00000100:00100000:1.0:1787383645.275625:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017472 00000100:00100000:1.0:1787383645.275669:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383645.275677:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985017472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.275723:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985017472:12345-0@lo:400:kworker.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383645.275729:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383645.275750:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017344 00000100:00100000:1.0:1787383645.275753:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017344 00000100:00100000:1.0:1787383645.275810:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018112 00000100:00100000:1.0:1787383645.275813:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018112 00000100:00100000:1.0:1787383645.275839:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383645.275845:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206985017344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.275876:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206985017344:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383645.275882:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383645.275894:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787383645.275900:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206985018112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.275924:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206985018112:12345-0@lo:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383645.275929:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787383645.275952:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383645.275967:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985017600:0@lo:8:kworker.0 00000100:00100000:1.0:1787383645.276000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383645.276021:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985017728:0@lo:8:kworker.0 00000100:00100000:1.0:1787383645.276040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787383645.276077:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f0000 x1874206985017344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383645.276089:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206985017344:0@lo:400:kworker.0 00010000:00080000:1.0:1787383645.276099:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f1880 x1874206985018112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383645.276106:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206985018112:0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.276114:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985017472:0@lo:400:kworker.0 00000100:00100000:2.0:1787383645.276190:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985017088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383645.276222:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383645.276246:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985017856:0@lo:400:kworker.0 00000100:00100000:2.0:1787383645.276266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383645.276280:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787383645.276285:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985017216:0@lo:400:kworker.0 00000100:00100000:2.0:1787383645.276305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383645.276321:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985017984:0@lo:400:kworker.0 00000100:00100000:2.0:1787383645.276339:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383645.276367:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017600 00000100:00100000:2.0:1787383645.276371:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017600 00000100:00100000:2.0:1787383645.276385:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017728 00000100:00100000:2.0:1787383645.276388:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017728 00000100:00100000:2.0:1787383645.276407:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383645.276411:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206985017600:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787383645.276436:0:24167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1787383645.276462:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec915330104 00002000:00100000:2.0:1787383645.276476:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff963503417000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787383645.276480:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787383645.276483:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787383645.276649:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787383645.276670:0:24167:0:(import.c:65:import_set_state_nolock()) ffff963503415000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383645.276709:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206985017600:12345-0@lo:8:kworker.0 Request processed in 296us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383645.276716:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787383645.276730:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383645.276735:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206985017728:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787383645.276745:0:24167:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787383645.277835:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017216 00000100:00100000:3.0:1787383645.277845:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017216 00000100:00100000:3.0:1787383645.277889:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383645.277897:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985017216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383645.277963:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985017216:12345-0@lo:400:kworker.0 Request processed in 66us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383645.277969:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383645.278008:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985017216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.279838:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017088 00000100:00100000:1.0:1787383645.279849:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017088 00000100:00100000:1.0:1787383645.279911:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787383645.279920:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3649:x1874206985017088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.279999:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3649:x1874206985017088:12345-0@lo:400:kworker.0 Request processed in 80us (3775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383645.280005:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787383645.280045:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017856 00000100:00100000:1.0:1787383645.280048:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017856 00000100:00100000:1.0:1787383645.280066:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985017984 00000100:00100000:1.0:1787383645.280069:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985017984 00000100:00100000:1.0:1787383645.280090:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383645.280095:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985017856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.280121:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985017856:12345-0@lo:400:kworker.0 Request processed in 27us (3855us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383645.280141:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787383645.280151:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787383645.280155:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985017984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383645.280179:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985017984:12345-0@lo:400:kworker.0 Request processed in 24us (3840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383645.280184:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787383645.280201:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787383645.280235:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f1180 x1874206985017600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383645.280245:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383645.280253:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1787383645.280260:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787383645.280265:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787383645.280268:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963503f63000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787383645.280279:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787383645.280284:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985017600:0@lo:8:kworker.0 00000004:00080000:1.0:1787383645.280331:0:23402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787383645.280349:0:23402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874206985018368:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787383645.280457:0:23401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787383645.280536:0:23401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 678308769874ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787383645.280542:0:23401:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787383645.280728:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383645.280740:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985018240:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787383645.280914:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f0700 x1874206985017984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383645.280926:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985017984:0@lo:400:kworker.0 00000100:00100000:3.0:1787383645.280936:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985017088:0@lo:400:kworker.0 00010000:00080000:3.0:1787383645.280946:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f3800 x1874206985017856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383645.280955:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985017856:0@lo:400:kworker.0 00000100:00100000:0.0:1787383645.285574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383645.285664:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018240 00000100:00100000:0.0:1787383645.285672:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018240 00000100:00100000:0.0:1787383645.285893:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787383645.286066:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985018240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383645.286168:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383645.286225:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985018240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 322us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383645.286232:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383645.286236:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383645.286260:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787383645.286267:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787383645.286281:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787383645.286311:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363692aa00 x1874206985018240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383645.286344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985018240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383645.286813:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018368 00000100:00100000:1.0:1787383645.286819:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018368 00000100:00100000:0.0:1787383645.287175:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383645.287184:0:24754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23402:x1874206985018368:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1787383645.287490:0:23402:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363466e6c0 going to sleep for 11 seconds 00000004:00080000:3.0:1787383645.291374:0:23393:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787383645.295405:0:24754:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1787383645.295416:0:24754:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787383645.295512:0:24754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23402:x1874206985018368:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8325us (9271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383645.295523:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787383645.295634:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963636929c00 x1874206985018368/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383645.295650:0:23402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874206985018368:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787383645.295663:0:23402:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787383645.295711:0:23402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874206985018496:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787383645.296016:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383645.296086:0:23402:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383645.304079:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206985017728:12345-0@lo:8:kworker.0 Request processed in 27334us (28028us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787383645.304094:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383645.304121:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018496 00000100:00100000:2.0:1787383645.304128:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018496 00000100:00100000:2.0:1787383645.305279:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383645.305293:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23402:x1874206985018496:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787383645.305324:0:24167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787383645.305382:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23402:x1874206985018496:12345-0@lo:5:osp-pre-0-1.0 Request processed in 94us (9366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383645.305389:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787383645.305455:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363ca50700 x1874206985018496/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383661 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383645.305470:0:23402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874206985018496:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787383645.305482:0:23402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787383645.305523:0:23402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874206985018624:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787383645.305553:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383645.305574:0:23402:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628c20e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383645.305660:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018624 00000100:00100000:1.0:1787383645.305665:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018624 00000100:00100000:1.0:1787383645.305706:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787383645.305713:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23402:x1874206985018624:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787383645.305754:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:0.0:1787383645.312336:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383645.312347:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787383645.312352:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985017728:0@lo:8:kworker.0 00000001:00080000:0.0:1787383645.331631:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1787383645.331650:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787383645.333658:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23402:x1874206985018624:12345-0@lo:5:osp-pre-0-1.0 Request processed in 27936us (28094us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787383645.333670:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787383645.334046:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96362d918a80 x1874206985018624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383645.334058:0:23402:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787383645.334064:0:23402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23402:1874206985018624:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787383645.334077:0:23402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1787383645.334125:0:23402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1874206985018752:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787383645.334159:0:23402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383645.334188:0:23402:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627a0e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383645.334306:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018752 00000100:00100000:0.0:1787383645.334312:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018752 00000100:00100000:0.0:1787383645.334353:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787383645.334361:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1874206985018752:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787383645.334410:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23402:x1874206985018752:12345-0@lo:900:osp-pre-0-1.0 Request processed in 49us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383645.334417:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787383645.334566:0:23402:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363ca50700 x1874206985018752/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383661 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383645.334577:0:23402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23402:1874206985018752:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1787383645.343266:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383646.362947:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383646.875321:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383646.878074:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985019008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787383646.878151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383646.878251:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985018880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383646.878276:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383646.884170:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019008 00000100:00100000:0.0:1787383646.884184:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019008 00000100:00100000:0.0:1787383646.884275:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985018880 00000100:00100000:0.0:1787383646.884279:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985018880 00000100:00100000:2.0:1787383646.884399:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383646.884410:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985019008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383646.884562:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383646.884637:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985019008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 229us (6485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383646.884644:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787383646.884661:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787383646.884668:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985018880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383646.884812:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985019008:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383646.884864:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383646.884977:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985018880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 309us (6699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383646.884984:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787383646.885042:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985018880:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383647.390045:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383648.411538:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383648.731929:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787383649.011051:0:24981:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787383649.011055:0:24981:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787383649.011062:0:24981:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787383649.011168:0:24981:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff96363722c800 00000020:01000004:0.0:1787383649.011185:0:24981:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787383649.011199:0:24981:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787383649.011213:0:24981:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff96350273cd40) 00000020:00000080:0.0:1787383649.011408:0:24981:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787383649.089661:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787383649.090741:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787383649.091288:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787383649.091473:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787383649.091661:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787383649.091977:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787383649.092245:0:24981:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1787383649.095022:0:24981:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787383649.095362:0:24981:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787383649.095383:0:24981:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787383649.095396:0:24981:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc40acec915330112 00000020:01000004:3.0:1787383649.095402:0:24981:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787383649.095423:0:24981:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.102@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787383649.095426:0:24981:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.102@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787383649.095431:0:24981:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787383649.095458:0:24981:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1787383649.095462:0:24981:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.102@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787383649.105118:0:24981:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.102@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787383649.105158:0:24981:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.102@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787383649.105162:0:24981:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787383649.105164:0:24981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383649.105166:0:24981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383649.105167:0:24981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383649.105168:0:24981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383649.105169:0:24981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383649.105171:0:24981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383649.105173:0:24981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383649.105174:0:24981:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383649.105178:0:24981:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787383649.105180:0:24981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383649.105182:0:24981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383649.105183:0:24981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383649.105184:0:24981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383649.105185:0:24981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383649.105186:0:24981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383649.105187:0:24981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383649.105188:0:24981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383649.105189:0:24981:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787383649.105216:0:24981:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787383649.105236:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019136:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787383649.105309:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383649.105366:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383649.105377:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019136 00000100:00100000:1.0:1787383649.105385:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019136 00000100:00100000:1.0:1787383649.105508:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787383649.105518:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24981:x1874206985019136:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787383649.105548:0:22653:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787383649.105551:0:22653:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787383649.105556:0:22653:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787383649.105905:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24981:x1874206985019136:12345-0@lo:253:mount.lustre.0 Request processed in 388us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.105914:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787383649.105922:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019136:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787383649.105931:0:24981:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787383649.105939:0:24981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383649.105940:0:24981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383649.105941:0:24981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383649.105942:0:24981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383649.105943:0:24981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383649.105944:0:24981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383649.105945:0:24981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383649.105946:0:24981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383649.105947:0:24981:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787383649.105966:0:24981:0:(tgt_mount.c:101:server_register_mount()) register mount ffff96363722c800 from lustre-OST0001 10000000:01000000:3.0:1787383649.105991:0:24981:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787383649.105994:0:24981:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787383649.106001:0:24981:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9636352c99c0 local copy 00010000:00010000:3.0:1787383649.106011:0:24981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383649.106080:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787383649.106101:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383649.106435:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.106488:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019264 00000100:00100000:2.0:1787383649.106494:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019264 00000100:00100000:2.0:1787383649.106568:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787383649.106576:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24981:x1874206985019264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383649.106651:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24981:x1874206985019264:12345-0@lo:501:mount.lustre.0 Request processed in 76us (548us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383649.106659:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787383649.106743:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019264:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787383649.106755:0:24981:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.102@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787383649.106796:0:24981:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.102@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787383649.106803:0:24981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.106812:0:24981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7e00/0xc40acec91532fe2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91532fe33 expref: -99 pid: 22638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383649.106856:0:24981:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff96363722c800 10000000:01000000:1.0:1787383649.106861:0:24981:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787383649.106866:0:24981:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787383649.106869:0:24981:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787383649.106873:0:24981:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787383649.106876:0:24981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787383649.106898:0:24981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.106909:0:24981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.106916:0:24981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383649.106926:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787383649.106948:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383649.106972:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963503723540 going to sleep for 11 seconds 00000100:00100000:3.0:1787383649.106983:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019392 00000100:00100000:3.0:1787383649.106987:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019392 00000100:00100000:3.0:1787383649.107018:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787383649.107024:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:24981:x1874206985019392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787383649.107032:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383649.107044:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0a00/0xc40acec915330120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330119 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.107063:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0a00/0xc40acec915330120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330119 expref: 22 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.107072:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0a00/0xc40acec915330120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330119 expref: 22 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.107091:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0a00, rc 0) 00000100:00100000:3.0:1787383649.107129:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019392:12345-0@lo:101:mount.lustre.0 Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.107135:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787383649.107165:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383649.107177:0:24981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330120 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.107187:0:24981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330120 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383649.108269:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1787383649.109188:0:24981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383649.111046:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787383649.111084:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787383649.111092:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787383649.111098:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787383649.111105:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787383649.111112:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787383649.111119:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787383649.111128:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787383649.111141:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1787383649.111171:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1787383649.111177:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1787383649.111278:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383649.111336:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.111382:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363466ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.111429:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019520 00000100:00100000:2.0:1787383649.111436:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019520 00000100:00100000:2.0:1787383649.111524:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787383649.111534:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383649.111680:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019520:12345-0@lo:501:mount.lustre.0 Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.111688:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787383649.111801:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383649.111844:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019648:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383649.111885:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.111967:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363466ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383649.112099:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019648 00000100:00100000:3.0:1787383649.112103:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019648 00000100:00100000:3.0:1787383649.112132:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787383649.112143:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383649.113087:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019648:12345-0@lo:503:mount.lustre.0 Request processed in 945us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.113094:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787383649.113186:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019648:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383649.113598:0:24981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383649.113745:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383649.113818:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.113854:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363466ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383649.113930:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019776 00000100:00100000:1.0:1787383649.113936:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019776 00000100:00100000:1.0:1787383649.113965:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787383649.113973:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787383649.114896:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019776:12345-0@lo:502:mount.lustre.0 Request processed in 920us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.114906:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787383649.114994:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383649.115204:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1787383649.115239:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1787383649.115255:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1787383649.115270:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787383649.115285:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787383649.115298:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787383649.115312:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787383649.115325:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787383649.115344:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787383649.115372:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019904:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383649.115411:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.115446:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363466ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1787383649.115452:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985019904 00000100:00100000:3.0:1787383649.115457:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985019904 00000100:00100000:3.0:1787383649.115493:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787383649.115500:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383649.115582:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985019904:12345-0@lo:502:mount.lustre.0 Request processed in 82us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.115589:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787383649.115798:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985019904:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383649.115836:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787383649.115845:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1787383649.116608:0:24985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787383649.116679:0:24985:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787383649.116686:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383649.116688:0:24985:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787383649.116695:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787383649.116708:0:24985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff963503700000) 00000020:00000080:2.0:1787383649.116738:0:24985:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787383649.116745:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787383649.116841:0:24985:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96363722c800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787383649.116850:0:24985:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787383649.116857:0:24985:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc40acec91533012e 00010000:00010000:2.0:1787383649.121034:0:24985:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1787383649.122576:0:24985:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1787383649.126584:0:24985:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787383649.132829:0:24985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787383649.132842:0:24985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383649.132850:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383649.132852:0:24985:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787383649.132855:0:24985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383649.132859:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383649.132861:0:24985:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787383649.132864:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787383649.132865:0:24985:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787383649.132868:0:24985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383649.132870:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383649.132872:0:24985:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787383649.132874:0:24985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787383649.132876:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383649.132877:0:24985:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787383649.132880:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787383649.132910:0:24985:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787383649.132912:0:24985:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787383649.132914:0:24985:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787383649.132916:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:0.0:1787383649.135407:0:24981:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787383649.135555:0:24981:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787383649.135581:0:24981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330120 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.135595:0:24981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7400/0xc40acec915330119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330120 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383649.135603:0:24981:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96363722c800 from 1 10000000:01000000:0.0:1787383649.135606:0:24981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383649.135644:0:24981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.135665:0:24981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.135677:0:24981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383649.135796:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787383649.135943:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.135995:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.136023:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020032 00000100:00100000:2.0:1787383649.136032:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020032 00000100:00100000:2.0:1787383649.136082:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787383649.136091:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985020032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787383649.136103:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383649.136116:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330135 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383649.136137:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330135 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383649.136147:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330135 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383649.136155:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9a00, rc 0) 00000100:00100000:2.0:1787383649.136202:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020032:12345-0@lo:101:mount.lustre.0 Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.136210:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787383649.136235:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383649.136250:0:24981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.136260:0:24981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383649.144519:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1787383649.146344:0:24981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383649.150956:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787383649.150995:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1787383649.151009:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1787383649.151021:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1787383649.151032:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1787383649.151045:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1787383649.151055:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1787383649.151066:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1787383649.151077:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1787383649.151086:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1787383649.151111:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1787383649.151128:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1787383649.151133:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1787383649.151238:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383649.151303:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.151349:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.151377:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020160 00000100:00100000:2.0:1787383649.151385:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020160 00000100:00100000:2.0:1787383649.151449:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787383649.151458:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383649.151584:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020160:12345-0@lo:501:mount.lustre.0 Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.151602:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787383649.151669:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383649.151701:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787383649.151751:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.151860:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383649.152094:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020288 00000100:00100000:3.0:1787383649.152099:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020288 00000100:00100000:3.0:1787383649.152133:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787383649.152139:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020288:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383649.152276:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020288:12345-0@lo:503:mount.lustre.0 Request processed in 136us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.152284:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787383649.152346:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020288:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787383649.153059:0:24981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787383649.153140:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383649.153186:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.153319:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383649.153359:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020416 00000100:00100000:3.0:1787383649.153365:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020416 00000100:00100000:3.0:1787383649.153391:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787383649.153399:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383649.153672:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020416:12345-0@lo:502:mount.lustre.0 Request processed in 273us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.153680:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787383649.153750:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383649.153961:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787383649.153984:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787383649.153994:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787383649.154005:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787383649.154015:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787383649.154025:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787383649.154035:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787383649.154045:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787383649.154055:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787383649.154065:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787383649.154076:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787383649.154100:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383649.154130:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.154193:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.154222:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020544 00000100:00100000:2.0:1787383649.154226:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020544 00000100:00100000:2.0:1787383649.154281:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787383649.154288:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383649.154366:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020544:12345-0@lo:502:mount.lustre.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.154372:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787383649.154425:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787383649.154468:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787383649.154475:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787383649.155189:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383649.155198:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155200:0:24989:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787383649.155207:0:24989:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96363722c800 00000020:00000080:0.0:1787383649.155210:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383649.155217:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383649.155219:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155220:0:24989:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787383649.155223:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383649.155225:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155226:0:24989:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787383649.155229:0:24989:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff96363722c800 00000020:00000080:0.0:1787383649.155231:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383649.155278:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383649.155281:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155283:0:24989:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787383649.155285:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383649.155287:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155288:0:24989:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383649.155292:0:24989:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96363722c800 00000020:00000080:0.0:1787383649.155294:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383649.155310:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383649.155312:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155313:0:24989:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787383649.155315:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787383649.155326:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155327:0:24989:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787383649.155331:0:24989:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff96363722c800 00000020:00000080:0.0:1787383649.155332:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787383649.155351:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787383649.155354:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787383649.155356:0:24989:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787383649.155359:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1787383649.156032:0:24981:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787383649.156064:0:24981:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383649.156120:0:24981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383649.156132:0:24981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787383649.156189:0:24981:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787383649.156192:0:24981:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff96363722c800 10000000:01000000:2.0:1787383649.156195:0:24981:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff96363722c800 10000000:01000000:2.0:1787383649.156198:0:24981:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787383649.156203:0:24981:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff96363722c800 from 1 10000000:01000000:2.0:1787383649.156206:0:24981:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787383649.156241:0:24981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383649.156250:0:24981:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383649.156262:0:24981:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383649.156283:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020672:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787383649.156338:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.156376:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635224000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383649.156881:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020672 00000100:00100000:1.0:1787383649.156889:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020672 00000100:00100000:1.0:1787383649.156948:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787383649.156966:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:24981:x1874206985020672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787383649.156983:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383649.156997:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636082a7000/0xc40acec91533014a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330143 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.157025:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636082a7000/0xc40acec91533014a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330143 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.157048:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636082a7000/0xc40acec91533014a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330143 expref: 24 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.157058:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a7000, rc 0) 00000100:00100000:1.0:1787383649.157115:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985020672:12345-0@lo:101:mount.lustre.0 Request processed in 151us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.157122:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787383649.157448:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787383649.157520:0:24981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533014a expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.157531:0:24981:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91533014a expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787383649.161709:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787383649.162117:0:24981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787383649.162335:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787383649.162361:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787383649.162377:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787383649.162391:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787383649.162417:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787383649.162437:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787383649.162451:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787383649.162466:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787383649.162481:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787383649.162515:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787383649.162531:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787383649.162546:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787383649.162560:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787383649.162577:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787383649.162594:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787383649.162642:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787383649.162658:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787383649.162671:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787383649.162684:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787383649.162700:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787383649.162716:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787383649.162737:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787383649.162755:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787383649.162795:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787383649.162812:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787383649.162842:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787383649.162861:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787383649.162878:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787383649.162893:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787383649.162909:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787383649.162924:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787383649.162938:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787383649.162953:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787383649.162967:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787383649.162984:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787383649.162997:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787383649.163010:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787383649.163026:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787383649.163041:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787383649.163056:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787383649.163070:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787383649.163102:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787383649.163119:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787383649.163132:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787383649.163145:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787383649.163158:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787383649.163171:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787383649.163186:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787383649.163310:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787383649.163331:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787383649.163352:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787383649.163358:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787383649.163446:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020800:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787383649.163514:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.163559:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db91b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.164319:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020800 00000100:00100000:2.0:1787383649.164328:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020800 00000100:00100000:2.0:1787383649.164385:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787383649.164396:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985020800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383649.164533:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985020800:12345-0@lo:501:mount.lustre.0 Request processed in 139us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.164660:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787383649.164724:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787383649.165831:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787383649.165885:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383649.165923:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fa4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787383649.165990:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985020928 00000100:00100000:2.0:1787383649.165996:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985020928 00000100:00100000:2.0:1787383649.166075:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787383649.166083:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985020928:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787383649.166173:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985020928:12345-0@lo:503:mount.lustre.0 Request processed in 91us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.166180:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787383649.166265:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985020928:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787383649.166624:0:24981:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787383649.168444:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985021056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383649.168518:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.168560:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635224300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383649.168608:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021056 00000100:00100000:3.0:1787383649.168615:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021056 00000100:00100000:3.0:1787383649.168755:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787383649.168785:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985021056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787383649.168910:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985021056:12345-0@lo:502:mount.lustre.0 Request processed in 146us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.168918:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787383649.169008:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985021056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383649.169232:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787383649.169417:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787383649.169437:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787383649.169449:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787383649.169461:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787383649.169473:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787383649.169486:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787383649.169511:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787383649.169523:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787383649.169535:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787383649.169548:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787383649.169562:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787383649.169575:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787383649.169589:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787383649.169604:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787383649.169614:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787383649.169624:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787383649.169634:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787383649.169645:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787383649.170589:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787383649.170621:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787383649.170633:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787383649.170644:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787383649.170655:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787383649.170679:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787383649.170697:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787383649.170712:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787383649.170723:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787383649.170746:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787383649.170758:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787383649.170789:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787383649.170805:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787383649.170821:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787383649.170832:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787383649.170842:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787383649.170866:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787383649.170880:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787383649.170892:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787383649.170906:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787383649.170921:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787383649.170940:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787383649.170950:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787383649.170961:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787383649.170973:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787383649.170984:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787383649.170996:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787383649.171011:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787383649.171023:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787383649.171069:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985021184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383649.171133:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.171169:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635224300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383649.171566:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021184 00000100:00100000:0.0:1787383649.171574:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021184 00000100:00100000:0.0:1787383649.171636:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787383649.171712:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985021184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383649.171864:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985021184:12345-0@lo:502:mount.lustre.0 Request processed in 219us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383649.171877:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787383649.172163:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985021184:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383649.172331:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787383649.172352:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787383649.172386:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985021312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787383649.172423:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.172457:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635224300 going to sleep for 11 seconds 00000100:00100000:0.0:1787383649.172489:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021312 00000100:00100000:0.0:1787383649.172495:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021312 00000100:00100000:0.0:1787383649.172529:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787383649.172536:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985021312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787383649.172607:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985021312:12345-0@lo:502:mount.lustre.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383649.172613:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787383649.172791:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985021312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787383649.172831:0:24981:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787383649.172839:0:24981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787383649.173432:0:24994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787383649.173446:0:24994:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff963628160000) 00000020:00000080:1.0:1787383649.173467:0:24994:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1787383649.173639:0:24994:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96363722c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787383649.173644:0:24994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96363722c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787383649.173646:0:24994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96363722c800 3 00010000:00080000:1.0:1787383649.173669:0:24994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff963504430000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.102@tcp at head 00010000:00010000:1.0:1787383649.175307:0:24994:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1787383649.175400:0:24994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787383649.175447:0:24994:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787383649.175461:0:24994:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc40acec915330158 00000100:00080000:1.0:1787383649.175471:0:24994:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383649.175477:0:24994:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff963504430000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383649.175507:0:24994:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363692b100 x1874206985021440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383649.175554:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206985021440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383649.175619:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383649.175672:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021440 00000100:00100000:1.0:1787383649.175678:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021440 00000100:00100000:1.0:1787383649.175704:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787383649.175711:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1874206985021440:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787383649.175745:0:22659:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1787383649.175842:0:22659:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc40acec91533015f 00000004:00100000:1.0:1787383649.175858:0:22659:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383649.175891:0:22659:0:(import.c:65:import_set_state_nolock()) ffff963620e92800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383649.175937:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1874206985021440:12345-0@lo:38:llog_process_th.0 Request processed in 225us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.175945:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787383649.175994:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363692b100 x1874206985021440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383649.176003:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383649.176009:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787383649.176015:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787383649.176019:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787383649.176022:0:3646:0:(import.c:65:import_set_state_nolock()) ffff963504430000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383649.176028:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1874206985021440:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787383649.176045:0:24994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787383649.176093:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383649.176097:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383649.176103:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1787383649.176105:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383649.176110:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787383649.176118:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985021568:0@lo:400:kworker.0 00000100:00080000:1.0:1787383649.176155:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383649.176160:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787383649.176164:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787383649.176165:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787383649.176173:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1787383649.176177:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787383649.176181:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96363db9f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383649.176195:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9635031f2d80 x1874206985022080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383649.176240:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985022208:0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383649.176291:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787383649.176297:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985021696:0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176319:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383649.176335:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206985022336:0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383649.176375:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985021824:0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176397:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985021952:0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.176452:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021952 00000100:00100000:1.0:1787383649.176463:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022208 00000100:00100000:1.0:1787383649.176467:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022208 00000100:00100000:1.0:1787383649.176489:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021696 00000100:00100000:1.0:1787383649.176491:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021696 00000100:00100000:2.0:1787383649.176507:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021952 00000100:00100000:1.0:1787383649.176509:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022336 00000100:00100000:1.0:1787383649.176514:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022336 00000100:00100000:1.0:1787383649.176550:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787383649.176562:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787383649.176563:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985022208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383649.176576:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985021952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176608:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1874206985022208:12345-0@lo:400:kworker.0 Request processed in 50us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.176616:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787383649.176631:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383649.176638:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985021696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176678:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985021696:12345-0@lo:400:kworker.0 Request processed in 41us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.176683:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787383649.176693:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787383649.176787:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985021952:12345-0@lo:400:kworker.0 Request processed in 60us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.176795:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787383649.176819:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787383649.176823:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787383649.176856:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363692aa00 x1874206985021952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383649.176864:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206985022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383649.176872:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985021952:0@lo:400:kworker.0 00000100:00100000:0.0:1787383649.176899:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021568 00000100:00100000:0.0:1787383649.176905:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021568 00000100:00100000:1.0:1787383649.176910:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206985022336:12345-0@lo:400:kworker.0 Request processed in 51us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.176918:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787383649.176953:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787383649.176963:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985021568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.176971:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.176999:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985021824 00000100:00100000:1.0:1787383649.177004:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206985022464:0@lo:400:kworker.0 00000100:00100000:2.0:1787383649.177006:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985021824 00000100:00100000:0.0:1787383649.177025:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985021568:12345-0@lo:400:kworker.0 Request processed in 63us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.177040:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.177050:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787383649.177081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff963636928380 x1874206985021696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383649.177091:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985021696:0@lo:400:kworker.0 00000100:00100000:0.0:1787383649.177109:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985021568:0@lo:400:kworker.0 00010000:00080000:1.0:1787383649.177116:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f3b80 x1874206985022336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383649.177138:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206985022336:0@lo:400:kworker.0 00000100:00100000:2.0:1787383649.177152:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1787383649.177156:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f3800 x1874206985022208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383649.177164:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985021824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.177170:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1874206985022208:0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.177201:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985022080:0@lo:8:kworker.0 00000100:00100000:2.0:1787383649.177212:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985021824:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383649.177219:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787383649.177231:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383649.177254:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985021824:0@lo:400:kworker.0 00000100:00100000:0.0:1787383649.177260:0:24754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022080 00000100:00100000:0.0:1787383649.177266:0:24754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022080 00000100:00100000:1.0:1787383649.177278:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022464 00000100:00100000:1.0:1787383649.177282:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022464 00000100:00100000:1.0:1787383649.177317:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383649.177323:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206985022464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383649.177354:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1874206985022464:12345-0@lo:400:kworker.0 Request processed in 32us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.177361:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:1.0:1787383649.177566:0:24994:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787383649.177579:0:24994:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9636281619c0) 00000020:00000080:1.0:1787383649.177597:0:24994:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1787383649.177724:0:24994:0:(tgt_mount.c:153:server_get_mount()) get mount ffff96363722c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787383649.177741:0:24994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff96363722c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787383649.177744:0:24994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff96363722c800 3 00010000:00080000:1.0:1787383649.177788:0:24994:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9636064d3800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.102@tcp at head 00000100:00100000:0.0:1787383649.177936:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383649.177943:0:24754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1874206985022080:12345-0@lo:8:kworker.0 00000100:00080000:2.0:1787383649.177954:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787383649.177999:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9635031f0700 x1874206985022464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383649.178009:0:24754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1874206985022080:12345-0@lo:8:kworker.0 Request processed in 63us (776us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787383649.178019:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383649.178048:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787383649.178054:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787383649.178058:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787383649.178061:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985022080:0@lo:8:kworker.0 00000100:00100000:2.0:1787383649.178118:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1874206985022464:0@lo:400:kworker.0 00010000:00010000:1.0:1787383649.179989:0:24994:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1787383649.180107:0:24994:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1787383649.180175:0:24994:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787383649.180196:0:24994:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xc40acec91533016d 00000100:00080000:1.0:1787383649.180206:0:24994:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787383649.180218:0:24994:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9636064d3800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:1.0:1787383649.180250:0:24994:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff96363d130a80 x1874206985022592/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787383649.180287:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206985022592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787383649.180364:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383649.180421:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022592 00000100:00100000:1.0:1787383649.180428:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022592 00000100:00100000:1.0:1787383649.180468:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787383649.180475:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1874206985022592:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787383649.180498:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:1.0:1787383649.180537:0:22660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xc40acec915330174 00000004:00100000:1.0:1787383649.180552:0:22660:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787383649.180584:0:22660:0:(import.c:65:import_set_state_nolock()) ffff96350377c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787383649.180637:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1874206985022592:12345-0@lo:38:llog_process_th.0 Request processed in 161us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.180645:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787383649.180673:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff96363d130a80 x1874206985022592/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787383659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383649.180682:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787383649.180688:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787383649.180694:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787383649.180698:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787383649.180701:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636064d3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787383649.180706:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1874206985022592:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787383649.180725:0:24994:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787383649.180761:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383649.180788:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787383649.180790:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787383649.180793:0:13975:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787383649.182235:0:24994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787383649.184848:0:24981:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787383649.184959:0:24981:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787383649.184977:0:24981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533014a expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.184989:0:24981:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636113c9600/0xc40acec915330143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533014a expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787383649.185051:0:24981:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787383649.185053:0:24981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383649.185055:0:24981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383649.185056:0:24981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383649.185058:0:24981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383649.185059:0:24981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383649.185061:0:24981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383649.185063:0:24981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383649.185064:0:24981:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787383649.185067:0:24981:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787383649.185070:0:24981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787383649.185071:0:24981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383649.185073:0:24981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383649.185074:0:24981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383649.185075:0:24981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383649.185076:0:24981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383649.185077:0:24981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383649.185078:0:24981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383649.185079:0:24981:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787383649.185104:0:24981:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787383649.185124:0:24981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985022720:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787383649.185194:0:24981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383649.185230:0:24981:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618feacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383649.185527:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022720 00000100:00100000:0.0:1787383649.185536:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022720 00000100:00100000:0.0:1787383649.185588:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787383649.185741:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:24981:x1874206985022720:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787383649.185811:0:22654:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787383649.185826:0:22654:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787383649.194470:0:22654:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787383649.194488:0:22654:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787383649.194508:0:22675:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787383649.194514:0:22675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787383649.194538:0:22675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.194557:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.194578:0:22675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec9153300f6 expref: 24 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.194586:0:22675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.194627:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec9153300f6 expref: 24 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.194641:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec9153300f6 expref: 24 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383649.194656:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985022848:0@lo:104: 00000100:00100000:0.0:1787383649.194726:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787383649.194809:0:22675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.194817:0:22675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383649.194828:0:22675:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985022976:0@lo:104: 00000100:00100000:0.0:1787383649.194854:0:22675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383649.194878:0:22675:0:(client.c:2702:ptlrpc_set_wait()) set ffff96363db916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383649.194900:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022848 00000100:00100000:0.0:1787383649.194906:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022848 00000100:00100000:0.0:1787383649.194937:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985022976 00000100:00100000:0.0:1787383649.194939:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985022976 00000100:00100000:0.0:1787383649.194952:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383649.194959:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:22675:x1874206985022848:12345-0@lo:104: 00010000:00010000:0.0:1787383649.194976:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.195038:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787383649.195203:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:22675:x1874206985022848:12345-0@lo:104: Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383649.195210:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383649.195228:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383649.195234:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985022976:12345-0@lo:104: 00010000:00010000:0.0:1787383649.195242:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.195392:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787383649.195399:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:22675:x1874206985022976:12345-0@lo:104: Request processed in 166us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383649.195405:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383649.195442:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985022848:0@lo:104: 00000100:00100000:0.0:1787383649.195454:0:22675:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e90700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22675:1874206985022976:0@lo:104: 00010000:00010000:0.0:1787383649.195475:0:22675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196685:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383649.196697:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196708:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fd800 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383649.196712:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196722:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383649.196754:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383649.196760:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787383649.196882:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196889:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383649.196914:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196922:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fd800/0xc40acec9153300f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300fd expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196934:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383649.196937:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383649.196942:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985023104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383649.196945:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fce00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:3.0:1787383649.196952:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.196959:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787383649.196965:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383649.196970:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1787383649.196991:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383649.196994:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.197003:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787383649.197021:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.197029:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fce00/0xc40acec9153300e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300ef expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383649.197036:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023104 00000100:00100000:1.0:1787383649.197041:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023104 00010000:00010000:3.0:1787383649.197045:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383649.197049:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383649.197051:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383649.197061:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec9153300f6 expref: 25 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383649.197091:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383649.197097:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+25:3650:x1874206985023104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383649.197108:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383649.197114:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec9153300f6 expref: 25 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.197124:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec9153300f6 expref: 25 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.197137:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636082a6400/0xc40acec9153300fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec9153300f6 expref: 25 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383649.197150:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383649.197180:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3650:x1874206985023104:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383649.197195:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787383649.197217:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985023232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383649.197242:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383649.197289:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383649.197292:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985023104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787383649.198727:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023232 00000100:00100000:3.0:1787383649.198746:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023232 00010000:00010000:3.0:1787383649.198797:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383649.198824:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383649.198833:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985023232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787383649.198845:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383649.198850:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198861:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198875:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636082a7600/0xc40acec9153300ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec9153300e8 expref: 24 pid: 22652 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198902:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198919:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787383649.198935:0:22646:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010648134s 00010000:00010000:3.0:1787383649.198941:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198948:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198955:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198962:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198968:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383649.198973:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198981:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.198994:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383649.199003:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383649.199054:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:3647:x1874206985023232:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.199062:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383649.203430:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985023232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383649.203752:0:22675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.203788:0:22675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383649.203797:0:22675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963610f16c00/0xc40acec91533017b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383649.206744:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:24981:x1874206985022720:12345-0@lo:253:mount.lustre.0 Request processed in 21128us (21531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383649.206758:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787383649.207089:0:24981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:24981:1874206985022720:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787383649.207104:0:24981:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787383649.207108:0:24981:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787383649.207110:0:24981:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787383649.207111:0:24981:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787383649.207113:0:24981:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787383649.207115:0:24981:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787383649.207116:0:24981:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787383649.207118:0:24981:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787383649.207120:0:24981:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787383649.207122:0:24981:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787383649.207138:0:24981:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1787383649.215250:0:24981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787383649.218432:0:24981:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787383649.218441:0:24981:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787383649.218475:0:24981:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787383649.218513:0:24981:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.102@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787383649.218530:0:24981:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787383649.218546:0:24981:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787383649.219397:0:24981:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383649.219654:0:24981:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787383649.436691:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787383650.106302:0:25049:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787383650.106844:0:25049:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787383650.459604:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985023360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383650.459699:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383650.459812:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023360 00000100:00100000:2.0:1787383650.459823:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023360 00000100:00100000:2.0:1787383650.459893:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787383650.459905:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985023360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383650.459945:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383650.460007:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985023360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383650.460032:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787383650.460039:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d919880 x1874206985023360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383650.460060:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985023360:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787383650.460411:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787383650.651852:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787383650.651864:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff963503110800 from 14 10000000:01000000:0.0:1787383650.651871:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787383650.651935:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383650.651950:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383650.651965:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383650.651999:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383650.652101:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383650.652152:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963605301d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787383650.652240:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023488 00000100:00100000:2.0:1787383650.652251:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023488 00000100:00100000:2.0:1787383650.652320:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787383650.652332:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985023488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383650.652348:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383650.652367:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636113c9800/0xc40acec915330189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330182 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383650.652392:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636113c9800/0xc40acec915330189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330182 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383650.652403:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636113c9800/0xc40acec915330189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330182 expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383650.652413:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9800, rc 0) 00000100:00100000:2.0:1787383650.652478:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985023488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383650.652485:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787383650.652745:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383650.652761:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330189 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383650.652793:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330189 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383650.652862:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787383650.652903:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383650.652933:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383650.653015:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023616 00000100:00100000:2.0:1787383650.653020:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023616 00000100:00100000:2.0:1787383650.653089:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787383650.653097:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985023616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383650.653112:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383650.653133:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383650.653137:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787383650.653229:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985023616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383650.653245:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787383650.653308:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787383650.653377:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787383650.653387:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330189 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383650.653396:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17a00/0xc40acec915330182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330189 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383650.653406:0:22656:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787383650.653413:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9635035fe000 from 14 10000000:01000000:1.0:1787383650.653415:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787383650.653450:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383650.653458:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383650.653466:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383650.653480:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383650.653510:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383650.654329:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037230c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383650.654477:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023744 00000100:00100000:0.0:1787383650.654488:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023744 00000100:00100000:0.0:1787383650.654579:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787383650.654599:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985023744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383650.654612:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383650.654630:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963610f16e00/0xc40acec915330197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330190 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383650.654657:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f16e00/0xc40acec915330197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330190 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383650.654667:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963610f16e00/0xc40acec915330197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330190 expref: 24 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383650.654677:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16e00, rc 0) 00000100:00100000:0.0:1787383650.654741:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985023744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383650.654748:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787383650.654963:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383650.654981:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330197 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383650.654992:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330197 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383650.655068:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787383650.655114:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383650.655148:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9635037230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383650.655276:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985023872 00000100:00100000:2.0:1787383650.655283:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985023872 00000100:00100000:2.0:1787383650.655318:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787383650.655326:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985023872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787383650.655348:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787383650.655368:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787383650.655374:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1787383650.655478:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985023872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383650.655486:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787383650.655754:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985023872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787383650.655878:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787383650.655888:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330197 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383650.655898:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636082a7a00/0xc40acec915330190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330197 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383651.227230:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383631/real 1787383631] req@ffff96363d131500 x1874206985010944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383651.227259:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363d131500 x1874206985010944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383651.227279:0:3646:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787383631/real 1787383631] req@ffff96363d131880 x1874206985011072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383651 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787383651.227292:0:3646:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff96363d131880 x1874206985011072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787383651 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787383651.227317:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383651.227339:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383651.227343:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985010944:0@lo:8:kworker.0 00000100:00080000:1.0:1787383651.227349:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787383651.227355:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787383651.227358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985011072:0@lo:8:kworker.0 00000100:00080000:0.0:1787383651.227633:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383651.227637:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787383651.227640:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383651.227645:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:0.0:1787383651.227650:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:3.0:1787383651.227781:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985024000:0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.227848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.227888:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383651.227895:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985024128:0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.227921:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.227953:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024000 00000100:00100000:3.0:1787383651.227966:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024000 00000100:00100000:3.0:1787383651.228012:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787383651.228022:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3649:x1874206985024000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.228066:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3649:x1874206985024000:12345-0@lo:400:kworker.0 Request processed in 46us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.228074:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787383651.228106:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024128 00000100:00100000:3.0:1787383651.228110:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024128 00000100:00100000:3.0:1787383651.228137:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383651.228143:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985024128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.228175:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985024128:12345-0@lo:400:kworker.0 Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.228181:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383651.228217:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985024128:0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.228226:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985024000:0@lo:400:kworker.0 00000100:00080000:0.0:1787383651.228638:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff96361122b800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383651.228930:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e91f80 x1874206985024256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383651.228966:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383651.228969:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383651.228972:0:13975:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383651.228976:0:13975:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 664 00000100:00080000:0.0:1787383651.228980:0:13975:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787383651.228984:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9636064d6800 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383651.228998:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e92300 x1874206985024384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787383651.229035:0:13975:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787383651.229039:0:13975:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787383651.229040:0:13975:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787383651.229046:0:13975:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff96363db9f000 using connection 192.168.203.102@tcp/0@lo 00000100:00100000:0.0:1787383651.229055:0:13975:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff963503e93480 x1874206985024896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787383651.229107:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985024640:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.229142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.229167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206985025280:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.229194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.229214:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787383651.229220:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206985024512:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.229241:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.229257:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206985025152:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.229278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.231067:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985024256:0@lo:8:kworker.0 00000100:00100000:3.0:1787383651.231135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.231181:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985024384:0@lo:8:kworker.0 00000100:00100000:3.0:1787383651.231207:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.231225:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985024896:0@lo:8:kworker.0 00000100:00100000:3.0:1787383651.231249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.231290:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024256 00000100:00100000:3.0:1787383651.231298:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024256 00000100:00100000:1.0:1787383651.232823:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206985025024:0@lo:400:kworker.0 00000100:00100000:1.0:1787383651.232935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.232968:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024640 00000100:00100000:1.0:1787383651.232969:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206985025536:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.232976:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024640 00000100:00100000:1.0:1787383651.233002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383651.233022:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787383651.233028:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383651.233031:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985024768:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.233042:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985024640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383651.233062:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383651.233086:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206985025408:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.233110:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985024640:12345-0@lo:400:kworker.0 Request processed in 70us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.233120:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787383651.233121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.233151:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025280 00000100:00100000:0.0:1787383651.233156:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025280 00000100:00100000:0.0:1787383651.233193:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024512 00000100:00100000:0.0:1787383651.233196:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024512 00000100:00080000:1.0:1787383651.233214:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383651.233214:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025152 00000100:00100000:0.0:1787383651.233219:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025152 00000100:00100000:0.0:1787383651.233241:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025024 00000100:00080000:1.0:1787383651.233242:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383651.233244:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025024 00000100:00100000:0.0:1787383651.233258:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025536 00000100:00100000:0.0:1787383651.233260:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025536 00000100:00100000:0.0:1787383651.233277:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025408 00000100:00100000:0.0:1787383651.233280:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025408 00000100:00080000:1.0:1787383651.233282:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383651.233286:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383651.233294:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383651.233302:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206985025280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.233341:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206985025280:12345-0@lo:400:kworker.0 Request processed in 40us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.233347:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787383651.233358:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787383651.233363:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206985024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.233387:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1874206985024512:12345-0@lo:400:kworker.0 Request processed in 25us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.233393:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383651.233858:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383651.233923:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206985025152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383651.233963:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1874206985025152:12345-0@lo:400:kworker.0 Request processed in 45us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383651.233969:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383651.233984:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787383651.233990:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206985025024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.234194:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024384 00000100:00100000:3.0:1787383651.234199:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024384 00000100:00100000:3.0:1787383651.234209:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024896 00000100:00100000:3.0:1787383651.234219:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024896 00000100:00100000:3.0:1787383651.234229:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985024768 00000100:00100000:3.0:1787383651.234231:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985024768 00000100:00100000:3.0:1787383651.234258:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383651.234265:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383651.234319:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206985025024:12345-0@lo:400:kworker.0 Request processed in 327us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383651.234327:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787383651.234343:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787383651.234353:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787383651.234355:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206985025536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383651.234365:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206985025408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383651.239569:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985024768:12345-0@lo:400:kworker.0 Request processed in 5295us (6500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.239583:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787383651.239617:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383651.239623:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206985024256:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787383651.239669:0:24167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1787383651.239700:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec91533019e 00002000:00100000:3.0:1787383651.239722:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff963503073000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787383651.239726:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787383651.239729:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787383651.239817:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787383651.239843:0:24167:0:(import.c:65:import_set_state_nolock()) ffff963503072000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383651.239909:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206985024256:12345-0@lo:8:kworker.0 Request processed in 285us (8774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.239917:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383651.239930:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383651.239934:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206985024384:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787383651.239950:0:24167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1787383651.239966:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc40acec9153301a5 00002000:00100000:3.0:1787383651.239972:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff963503074000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787383651.239975:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787383651.239997:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787383651.240155:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787383651.240174:0:24167:0:(import.c:65:import_set_state_nolock()) ffff963503076800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383651.240317:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1874206985024384:12345-0@lo:8:kworker.0 Request processed in 381us (9109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.240324:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383651.240337:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383651.240342:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1874206985024896:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787383651.240357:0:24167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 684 last 0 00000020:00000080:3.0:1787383651.240372:0:24167:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xc40acec9153301ac 00002000:00100000:3.0:1787383651.240378:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff963503073800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113672 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787383651.240381:0:24167:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787383651.240383:0:24167:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787383651.240404:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787383651.240510:0:24167:0:(import.c:65:import_set_state_nolock()) ffff963503070800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383651.240549:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1874206985024896:12345-0@lo:8:kworker.0 Request processed in 205us (9298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.240559:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787383651.240603:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787383651.241383:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e91f80 x1874206985024256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383651.241395:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383651.241403:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787383651.241884:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787383651.241892:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787383651.241896:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96361122b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787383651.241918:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787383651.241939:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985024256:0@lo:8:kworker.0 00010000:00080000:3.0:1787383651.241957:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e92300 x1874206985024384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383651.241966:0:3646:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787383651.241970:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787383651.241975:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787383651.241978:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787383651.241980:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9636064d6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787383651.242077:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787383651.242082:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1874206985024384:0@lo:8:kworker.0 00010000:00080000:3.0:1787383651.242101:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e93480 x1874206985024896/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787383676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787383651.242115:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787383651.242120:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787383651.242126:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787383651.242128:0:3646:0:(import.c:65:import_set_state_nolock()) ffff96363db9f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787383651.242143:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787383651.242147:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1874206985024896:0@lo:8:kworker.0 00000004:00080000:3.0:1787383651.242193:0:22683:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787383651.242563:0:22683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 684270732900ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787383651.242836:0:22683:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787383651.242897:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1787383651.243046:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874206985025792:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1787383651.243118:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.243152:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397300 going to sleep for 11 seconds 00000100:00100000:3.0:1787383651.247832:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985025664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383651.247917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.247998:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025664 00000100:00100000:3.0:1787383651.248006:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025664 00000100:00100000:3.0:1787383651.248057:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383651.248066:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985025664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383651.248094:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383651.248139:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1874206985025664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.248145:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787383651.248169:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787383651.248197:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504693100 x1874206985025664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383651.248216:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985025664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383651.248250:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025792 00000100:00100000:3.0:1787383651.248253:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025792 00000100:00100000:3.0:1787383651.248276:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787383651.248283:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1874206985025792:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:2.0:1787383651.249255:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e91180 x1874206985025024/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383651.249269:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206985025024:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.249327:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206985025536:12345-0@lo:400:kworker.0 Request processed in 14975us (16325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.249337:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:0.0:1787383651.249405:0:22684:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787383651.249422:0:22684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1874206985026048:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787383651.249457:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.249473:0:22684:0:(client.c:2702:ptlrpc_set_wait()) set ffff963601377600 going to sleep for 11 seconds 00000004:00080000:0.0:1787383651.249487:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787383651.249565:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 684277798883ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787383651.249571:0:23403:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787383651.249594:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026048 00000100:00100000:0.0:1787383651.249598:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026048 00000100:00100000:0.0:1787383651.249631:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383651.249639:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22684:x1874206985026048:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787383651.249812:0:22686:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787383651.249827:0:22686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1874206985026304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787383651.249859:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.249875:0:22686:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fa4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787383651.249890:0:24168:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787383651.249896:0:24168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787383651.249955:0:24754:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383651.249963:0:24754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026304 00000100:00100000:0.0:1787383651.249967:0:24754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026304 00010000:00080000:2.0:1787383651.250078:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447dc00 x1874206985025536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383651.250090:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206985025536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383651.250108:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787383651.250118:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985026176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383651.250151:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383651.250175:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026176 00000100:00100000:2.0:1787383651.250179:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026176 00000100:00100000:2.0:1787383651.250206:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787383651.250213:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206985026176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383651.250225:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787383651.250265:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206985026176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383651.250272:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787383651.250316:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504693100 x1874206985026176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383651.250508:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985026176:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787383651.250525:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e91880 x1874206985024768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383651.250535:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985024768:0@lo:400:kworker.0 00000100:00100000:1.0:1787383651.250645:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206985025408:12345-0@lo:400:kworker.0 Request processed in 16282us (17525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383651.250656:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1787383651.250685:0:22685:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787383651.250787:0:22685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 684279020878ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787383651.250794:0:22685:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:2.0:1787383651.251032:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447d500 x1874206985025408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383651.251044:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206985025408:0@lo:400:kworker.0 00000100:00080000:2.0:1787383651.253753:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383651.253763:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787383651.253794:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787383651.253826:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985025920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383651.253894:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383651.253948:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985025920 00000100:00100000:2.0:1787383651.253955:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985025920 00000100:00100000:2.0:1787383651.253998:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787383651.254006:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874206985025920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383651.254028:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383651.254068:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1874206985025920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383651.254075:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787383651.254123:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447ce00 x1874206985025920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383651.254140:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985025920:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787383651.256140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e93800 x1874206985024512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383651.256159:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1874206985024512:0@lo:400:kworker.0 00010000:00080000:0.0:1787383651.256173:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e92d80 x1874206985025152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383651.256181:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1874206985025152:0@lo:400:kworker.0 00000100:00100000:0.0:1787383651.256192:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985024640:0@lo:400:kworker.0 00010000:00080000:0.0:1787383651.256214:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447e300 x1874206985025280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383651.256223:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206985025280:0@lo:400:kworker.0 00000004:00080000:3.0:1787383651.256689:0:22639:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787383651.260540:0:24169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787383651.260553:0:24169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1787383651.260559:0:24169:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000004:00080000:0.0:1787383651.262207:0:23393:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:1.0:1787383651.262662:0:24167:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1787383651.262668:0:24167:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787383651.262787:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1874206985025792:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14478us (19646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383651.262799:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383651.262829:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787383651.262840:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22686:x1874206985026304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787383651.264186:0:24167:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787383651.264199:0:24167:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787383651.264203:0:24167:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00010000:00080000:3.0:1787383651.269303:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504690a80 x1874206985025792/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787383667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383651.269377:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874206985025792:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1787383651.269393:0:23404:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787383651.269507:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874206985026432:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787383651.269563:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383651.269598:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff963611397300 going to sleep for 11 seconds 00000100:00100000:2.0:1787383651.271234:0:24754:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787383651.271250:0:24754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026432 00000100:00100000:2.0:1787383651.271258:0:24754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026432 00002000:00010000:2.0:1787383651.271692:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.271702:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.271744:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.271749:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.271755:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.271791:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.271802:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.271811:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.271830:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.272003:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.272010:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272026:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.272030:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272039:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272055:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272062:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec9153301b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787383651.272544:0:22639:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787383651.272872:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.272875:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.272878:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.272936:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.272942:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272954:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.272958:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.272964:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272975:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272991:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.272999:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.273015:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.273155:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.273161:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.273169:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.273172:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.273181:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.273195:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.273204:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec9153301ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.273216:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.273223:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.273224:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383651.275320:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383651.275338:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23404:x1874206985026432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787383651.275369:0:25116:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1787383651.275444:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23404:x1874206985026432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 112us (5879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.275451:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787383651.275495:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504690a80 x1874206985026432/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787383667 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383651.275509:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874206985026432:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787383651.275519:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787383651.275558:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874206985026560:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787383651.275586:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.275602:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff963628c20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787383651.275613:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026560 00000100:00100000:0.0:1787383651.275618:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026560 00000100:00100000:0.0:1787383651.275640:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383651.275644:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23404:x1874206985026560:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1787383651.275666:0:25116:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1787383651.276824:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.276834:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.276856:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.276860:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.276866:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.276881:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.276891:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.276900:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.276917:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.277185:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.277192:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.277201:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.277206:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.277216:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.277235:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.277242:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec9153301c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.277258:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.277260:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.277262:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.281258:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.281271:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.281288:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.281293:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.281300:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.281313:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.281339:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.281347:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.281374:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383651.281402:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.281410:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.281421:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.281426:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.281444:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.281465:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.281473:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef5d4515/0xc40acec9153301c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.281495:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.281503:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.281506:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.283671:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.283682:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.283698:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.283703:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.283709:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.283734:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.283743:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.283752:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.283789:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.283792:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.283801:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.283811:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.283816:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.283827:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.283849:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.283858:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153301cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.283881:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383651.283882:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.283890:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.283892:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.283896:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.283904:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.283907:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.283912:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.283922:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.283930:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.283937:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.283997:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.284165:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.284171:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284179:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.284183:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383651.284352:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.284358:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.284366:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.284369:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.284374:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.284389:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383651.284397:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.284398:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.284403:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.284406:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.284410:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.284413:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.284417:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.284427:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.284431:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.284438:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.284446:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.284454:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787383651.284581:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284595:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284602:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004387c52e/0xc40acec9153301d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284618:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383651.284621:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284628:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.284632:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284650:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284662:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284669:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b34412ae/0xc40acec9153301dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284682:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.284686:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284692:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.284695:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284702:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284711:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284742:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153301e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.284814:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.284817:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.284818:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.285351:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.285358:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285369:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.285373:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.285379:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285389:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285396:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285414:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285528:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787383651.285730:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.285736:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.285745:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.285748:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.285752:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.285761:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.285789:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.285796:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383651.285849:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.285855:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285866:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.285869:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.285876:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285885:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285893:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.285899:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286761:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383651.286780:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286790:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.286794:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286813:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286831:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286838:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec9153301eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286857:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383651.286861:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286867:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.286870:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286877:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286886:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286894:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.286897:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286910:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.286913:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286920:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286930:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.286937:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.286939:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.286941:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.287358:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.287885:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383651.287894:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fde665cd/0xc40acec9153301f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.288131:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.288294:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787383651.288301:0:24167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153301f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.288471:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.288736:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.288743:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.288756:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.288760:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.288783:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.288795:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.288804:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.288811:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.288828:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383651.289816:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.289823:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.289835:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.289838:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.289848:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.289859:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.289868:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.289875:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.289892:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787383651.289988:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787383651.289993:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.290002:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.290006:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.290015:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.290029:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.290046:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec915330200 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.290064:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.290068:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.290095:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.290592:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.290604:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.290613:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.290616:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.290620:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.290629:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.290637:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.290643:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.290667:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.290674:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.291809:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6400 already unused, calling callback (ffffffffc0ca5e90) 00002000:00010000:3.0:1787383651.292225:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.292233:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.292245:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.292249:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.292255:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.292272:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.292295:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.292308:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.292318:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.292506:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292517:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292534:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292541:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000922f5e6d/0xc40acec915330207 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292561:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.292565:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292572:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.292581:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292590:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292600:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292606:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099ee0862/0xc40acec915330215 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.292620:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.292621:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.292623:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.292685:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.292691:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.292699:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.292702:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.292707:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.292737:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.292744:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.292751:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.292786:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.293268:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.293274:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293282:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.293285:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293293:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293305:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293319:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec91533021c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293333:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.293334:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.293336:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.293761:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.293860:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.293862:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.293866:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.293872:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293883:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.293886:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.293892:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293902:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293910:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293917:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.293937:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.294120:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.294125:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294133:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.294137:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294147:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294171:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294178:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000687eedbd/0xc40acec915330223 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294191:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.294193:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.294194:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.294369:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294378:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.294381:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294388:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294401:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294408:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4813613/0xc40acec91533020e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294421:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.294423:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.294500:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.294572:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.294584:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.294592:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.294595:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.294601:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.294611:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.294620:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.294627:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.294647:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787383651.294757:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.294785:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294794:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.294797:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.294801:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294811:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294819:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294826:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294831:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.294835:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.294843:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.294843:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.294846:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294854:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294865:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294935:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec91533022a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294961:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.294965:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294971:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.294974:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294982:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294992:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.294999:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d94a570/0xc40acec915330231 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.295013:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.295015:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.295016:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.295048:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.295326:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.295332:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295341:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.295344:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.295349:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295373:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295381:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295389:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295403:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.295410:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.295414:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295421:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.295424:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295431:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295442:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295448:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec915330238 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.295467:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.295469:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.295471:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.295623:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.295629:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.295637:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.295646:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.295650:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.295660:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.295668:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.295676:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.295694:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.295983:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.295989:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.295996:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.296000:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.296008:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.296021:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.296028:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533023f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.296070:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.296294:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.296297:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.296305:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.296311:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296320:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.296323:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.296328:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296338:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296346:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296359:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296371:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.296450:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.296455:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296462:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.296465:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296472:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296483:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296490:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330246 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296503:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.296505:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.296506:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.296543:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.296554:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296563:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.296566:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.296570:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296580:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296587:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296593:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.296611:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383651.296698:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.296704:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.296711:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.296723:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.296740:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.296750:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.296756:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f07bfe6/0xc40acec91533024d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.296786:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.296788:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.296789:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787383651.297572:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.297580:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.297590:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.297594:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.297599:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.297608:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.297616:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.297629:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.297645:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.297928:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.297934:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.297942:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.297946:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.297954:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.297968:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.297974:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b185c640/0xc40acec915330254 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.298176:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.298178:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.298180:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.300455:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.300469:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.300484:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.300488:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.300494:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.300506:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.300523:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.300531:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.300555:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.300954:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.300962:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.300970:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.300975:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.300984:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.301000:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.301007:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7ab67d6/0xc40acec91533025b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.301025:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.301027:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.301028:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.301354:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.301360:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.301369:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.301372:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.301377:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.301391:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.301400:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.301406:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787383651.301578:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.301584:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.301601:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.301604:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.301608:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.301617:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.301625:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.301632:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.301754:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383651.302049:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383651.302056:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302063:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.302067:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302084:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302098:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302105:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fde665cd/0xc40acec915330269 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302119:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.302122:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302140:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.302143:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302151:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302160:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.302168:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.302169:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.302171:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.302286:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787383651.302291:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e63f6b5e/0xc40acec915330262 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.302418:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.306973:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.306988:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307007:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.307012:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.307017:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307030:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307039:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307046:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307068:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787383651.307385:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.307392:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307406:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.307409:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.307414:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307423:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307441:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307448:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307467:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787383651.307677:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787383651.307685:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307694:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.307699:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307709:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307738:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307752:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e522f6d0/0xc40acec915330270 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787383651.307761:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.307783:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307791:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.307791:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.307794:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.307795:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307799:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307803:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.307806:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307808:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307814:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307824:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307826:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307831:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045bb1fa0/0xc40acec915330277 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.307834:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307842:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.307843:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.307846:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307862:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.307865:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307873:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307883:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.307890:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.307892:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.308836:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.308960:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787383651.308969:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c3d5866/0xc40acec91533027e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309153:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.309217:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.309224:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309235:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.309238:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.309244:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309268:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309276:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309283:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309309:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787383651.309351:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.309356:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.309365:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.309368:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.309372:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.309381:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.309389:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.309406:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309408:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.309413:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.309420:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.310050:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310063:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310090:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310097:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053ae990e/0xc40acec915330285 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310120:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.310124:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310130:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.310133:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310140:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310150:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.310157:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.310159:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.312316:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787383651.312318:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.312328:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddca1b20/0xc40acec91533028c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.312357:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.312363:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.312493:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.312501:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.312514:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.312518:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.312524:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.312551:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.312560:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.312568:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.312617:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383651.313510:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.313519:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.313529:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.313534:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.313544:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.313562:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.313576:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec3112d0/0xc40acec915330293 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.313593:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.313595:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.313597:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.313756:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.313763:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.313791:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.313795:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.313800:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.313810:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.313818:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.313826:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.313854:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.313863:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.313867:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.313875:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.313885:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.313894:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.313905:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.313913:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3951b8/0xc40acec91533029a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.313933:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.313935:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.313936:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.315592:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.315605:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.315621:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.315626:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.315632:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.315644:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.315662:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.315671:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.315692:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383651.316817:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.316827:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.316837:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.316842:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.316851:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.316868:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.316875:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063c86932/0xc40acec9153302a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.316901:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.316903:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.316905:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.317833:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.317843:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.317866:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.317870:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.317876:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.318001:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.318010:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.318017:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.318065:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787383651.318334:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787383651.318340:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.318348:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.318352:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.318361:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.318375:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.318382:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066f36627/0xc40acec9153302a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.318397:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.318399:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.318400:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.319009:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.319016:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.319026:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.319029:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.319035:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.319045:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.319054:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.319061:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.319092:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787383651.319801:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.319809:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.319820:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.319823:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.319828:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.319838:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.319856:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.319863:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.319888:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787383651.319894:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383651.319900:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319908:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.319918:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319926:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319941:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319949:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4813613/0xc40acec9153302af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319963:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.319967:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319973:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.319976:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319983:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.319993:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.320000:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000922f5e6d/0xc40acec9153302b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.320019:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.320020:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.320022:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.322293:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.322305:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322320:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.322324:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.322330:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322342:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322351:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322358:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322392:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.322537:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.322543:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322551:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.322556:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322565:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322581:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322588:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4bcf49b/0xc40acec9153302bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.322606:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.322608:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.322609:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.322709:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.322724:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322733:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.322737:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.322741:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322753:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322760:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322783:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322797:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.322804:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.322808:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322828:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.322831:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322839:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322850:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322857:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fe1653a/0xc40acec9153302c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.322883:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.322885:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.322886:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.323117:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.323123:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.323131:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.323139:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.323143:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.323152:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.323159:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.323166:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.323188:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.323557:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.323563:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323571:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.323576:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323584:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323604:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323612:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81c7f2f/0xc40acec9153302cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323627:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.323629:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.323631:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.323822:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.323828:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323837:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.323840:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.323845:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323855:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323863:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323870:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323900:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.323908:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.323912:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323919:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.323922:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323930:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323942:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323949:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9c919c7/0xc40acec9153302d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.323962:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.323965:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.323966:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.323990:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.323995:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324003:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.324006:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.324010:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324019:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324026:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324037:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324051:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.324514:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.324519:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324526:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.324530:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324537:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324549:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324556:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f41d550d/0xc40acec9153302d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324571:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.324573:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.324574:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.324875:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.324960:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324970:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.324974:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.324979:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324989:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.324997:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325005:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325024:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.325172:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.325178:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325195:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.325199:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325207:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325219:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325226:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000687eedbd/0xc40acec9153302e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325242:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.325244:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.325245:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.325535:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.325542:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325551:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.325555:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.325560:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325569:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325583:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325590:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.325613:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.325782:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.325788:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325796:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.325800:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325807:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325828:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325835:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057ad162e/0xc40acec9153302e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.325847:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.325849:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.325851:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.326283:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.326290:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.326298:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.326301:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.326306:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.326317:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.326325:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.326333:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.326441:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787383651.326472:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.326477:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.326484:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.326488:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.326496:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.326508:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.326515:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee207a78/0xc40acec9153302ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.326541:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.326543:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.326545:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.326574:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.333018:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.333033:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333051:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.333062:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.333068:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333085:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333095:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333103:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333130:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.333141:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.333147:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333155:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.333160:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333170:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333187:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333207:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a22980/0xc40acec9153302f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.333227:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.333229:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.333231:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787383651.334438:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.334449:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.334462:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.334466:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.334472:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.334483:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.334492:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.334500:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.334521:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787383651.334964:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787383651.334975:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.334985:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.334988:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.334993:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.335002:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.335011:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.335019:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.335049:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787383651.335386:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383651.335393:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335402:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.335407:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335416:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335432:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335440:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f50e5a5/0xc40acec9153302fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335455:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383651.335458:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335464:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:0.0:1787383651.335473:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335479:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335488:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335495:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aceb106/0xc40acec915330303 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335507:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.335508:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.335510:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787383651.335761:0:24982:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00002000:00010000:0.0:1787383651.335794:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.335799:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787383651.335803:0:24982:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787383651.335808:0:24982:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787383651.335808:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.335811:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.335816:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335825:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335833:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.335847:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.336042:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787383651.336293:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23404:x1874206985026560:12345-0@lo:5:osp-pre-1-1.0 Request processed in 60643us (60701us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1787383651.336303:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787383651.336350:0:23404:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787383651.336358:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23404:1874206985026560:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787383651.336373:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1787383651.336416:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1874206985026688:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787383651.336453:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.336473:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1787383651.336491:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026688 00000100:00100000:0.0:1787383651.336497:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026688 00000100:00100000:0.0:1787383651.336536:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787383651.336543:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1874206985026688:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787383651.336585:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1874206985026688:12345-0@lo:900:osp-pre-1-1.0 Request processed in 42us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.336591:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787383651.336616:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96350447e300 x1874206985026688/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787383667 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787383651.336627:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1874206985026688:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1787383651.336710:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.336729:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.336739:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.336742:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.336747:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.336757:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.336785:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.336792:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337020:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383651.337027:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337035:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.337040:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337055:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337080:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337088:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053ae990e/0xc40acec91533030a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383651.337091:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.337097:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337105:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.337107:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=684s v=(0 0) 00010000:00010000:2.0:1787383651.337108:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.337110:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787383651.337115:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.337115:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337118:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.337124:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337126:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.337133:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337136:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.337141:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337143:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.337145:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.337158:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.337159:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.337163:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337169:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.337172:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337179:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337187:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337194:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d87736d/0xc40acec915330318 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.337207:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.337209:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.337210:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.337383:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383651.338777:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787383651.338787:0:24169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d31c7c2/0xc40acec915330311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.338816:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.338854:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.338861:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.338872:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.338881:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.338886:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.338898:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.338907:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.338914:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.338935:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.338992:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.338998:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339006:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.339009:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339028:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339043:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339051:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040330a24/0xc40acec91533031f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339065:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.339066:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.339068:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.339367:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.339573:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.339579:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.339589:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.339592:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.339597:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.339607:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.339615:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.339628:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.339650:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.339800:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.339805:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339813:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829a00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.339817:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339825:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339837:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339856:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006871a7c2/0xc40acec915330326 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.339871:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.339873:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.339875:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787383651.339991:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.339998:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340015:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.340018:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.340021:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340030:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340038:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340044:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340065:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787383651.340372:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.340378:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340386:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.340388:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.340392:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340400:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340419:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340426:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.340444:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787383651.340448:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.340453:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.340461:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.340464:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.340468:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.340477:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.340485:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.340492:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.340503:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787383651.340697:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787383651.340703:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340711:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.340726:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340734:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340749:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340756:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041297319/0xc40acec91533032d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340799:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383651.340803:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340814:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16400 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.340817:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340824:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340834:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340841:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2e91989/0xc40acec915330334 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.340853:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.340853:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.340854:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.340856:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.340858:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.340860:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.340866:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383651.340873:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.340946:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.340957:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.340964:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc808ea3/0xc40acec91533033b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.340977:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.340979:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.340981:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787383651.341112:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787383651.341118:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.341133:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=684s v=(0 0) 00010000:00010000:1.0:1787383651.341136:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383651.341140:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.341150:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.341158:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.341165:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.341186:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787383651.341229:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787383651.341235:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.341242:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=684s v=(0 0) 00010000:00010000:0.0:1787383651.341245:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383651.341249:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.341258:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.341265:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.341272:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383651.341340:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1787383651.341564:0:24169:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:0.0:1787383651.341657:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22684:x1874206985026048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 92015us (92195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383651.341666:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383651.341726:0:22684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1874206985026048:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787383651.341741:0:22684:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:0.0:1787383651.341800:0:22684:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1874206985026816:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787383651.341830:0:22684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383651.341852:0:22684:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636183e59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383651.341868:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026816 00000100:00100000:0.0:1787383651.341873:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026816 00000100:00100000:0.0:1787383651.341918:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383651.341926:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22684:x1874206985026816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787383651.341958:0:24168:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1787383651.342538:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787383651.342546:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342556:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605828e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.342561:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342582:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342600:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342608:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000120a8ba7/0xc40acec915330342 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342625:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.342629:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342636:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.342639:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342648:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342658:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342666:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eeb0b68/0xc40acec915330349 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.342691:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.342693:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.342695:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.345834:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787383651.346013:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787383651.346057:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1787383651.346235:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.346245:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.346261:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.346265:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.346270:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.346283:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.346305:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.346313:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.346336:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787383651.346751:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383651.346758:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.346786:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383651.346791:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.346800:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.346825:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.346832:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e82d1923/0xc40acec915330350 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383651.346850:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.346852:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383651.346854:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383651.346856:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22684:x1874206985026816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4927us (5022us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787383651.346866:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383651.347012:0:22684:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787383651.347021:0:22684:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22684:1874206985026816:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787383651.347035:0:22684:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:3.0:1787383651.347292:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.347299:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.347308:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.347312:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.347317:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.347325:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.347333:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.347340:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.347373:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.350968:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.350980:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.350993:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1800 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.350997:0:25118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383651.350999:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.351006:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351008:0:25118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351020:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.351024:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.351029:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351029:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351037:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025d5edb2/0xc40acec915330357 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351041:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351049:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351053:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.351054:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.351056:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351056:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.351069:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787383651.351081:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.351086:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351093:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0000 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.351096:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351103:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351114:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.351121:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.351123:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.351124:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383651.351204:0:24167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b185c640/0xc40acec91533035e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787383651.351569:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787383651.351575:0:24167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351591:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=684s v=(0 0) 00010000:00010000:3.0:1787383651.351594:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787383651.351599:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351609:0:24167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351617:0:24167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351624:0:24167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383651.351646:0:24167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787383651.351740:0:24167:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1787383651.351847:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22686:x1874206985026304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89005us (101983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383651.351857:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383651.352033:0:22686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1874206985026304:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787383651.352047:0:22686:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1787383651.352162:0:22686:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1874206985026944:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787383651.352197:0:22686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787383651.352975:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383651.352984:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.352994:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0200 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383651.352999:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.353009:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.353039:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.353047:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d94a570/0xc40acec915330365 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383651.353072:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.353074:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383651.353076:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383651.353318:0:22686:0:(client.c:2702:ptlrpc_set_wait()) set ffff963618fa4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787383651.353527:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985026944 00000100:00100000:0.0:1787383651.353534:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985026944 00000100:00100000:0.0:1787383651.353585:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383651.353594:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:22686:x1874206985026944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787383651.353633:0:25116:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1787383651.356035:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:22686:x1874206985026944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2436us (3830us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787383651.356046:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787383651.356130:0:22686:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22686:1874206985026944:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787383651.356145:0:22686:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1787383651.487259:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383651.997211:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985027072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383651.997304:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383651.997387:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027072 00000100:00100000:1.0:1787383651.997397:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027072 00000100:00100000:1.0:1787383651.997465:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383651.997476:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985027072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383651.997524:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787383651.997952:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985027200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383652.002703:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985027072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5215us (5385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383652.002733:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787383652.002896:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985027072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383652.003478:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383652.004168:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027200 00000100:00100000:1.0:1787383652.004180:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027200 00000100:00100000:1.0:1787383652.004231:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383652.004239:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985027200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383652.004286:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787383652.004365:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985027200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383652.004394:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787383652.004448:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985027200:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787383652.511243:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383653.532034:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787383653.787689:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787383654.554876:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787383654.685062:0:25341:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg302-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787383655.579230:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383655.579231:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383655.579261:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985027328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383655.579354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383655.579626:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027328 00000100:00100000:2.0:1787383655.579637:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027328 00000100:00100000:2.0:1787383655.579716:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383655.579730:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985027328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787383655.579793:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383655.579853:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985027328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383655.579861:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787383655.579928:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985027328:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787383655.580007:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:2.0:1787383655.951072:0:25393:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787383655.951364:0:25393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787383656.607700:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985027456:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.607803:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.607846:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985027968:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.607870:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.607888:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985028480:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.607911:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.607931:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206985028992:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.607959:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.607988:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787383656.607996:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985027584:0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.608003:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027968 00000100:00100000:1.0:1787383656.608011:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027968 00000100:00100000:3.0:1787383656.608022:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608044:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985028096:0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.608061:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028480 00000100:00100000:3.0:1787383656.608067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383656.608068:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028480 00000100:00100000:3.0:1787383656.608088:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985028608:0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.608089:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028992 00000100:00100000:1.0:1787383656.608095:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028992 00000100:00100000:3.0:1787383656.608115:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608126:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985029120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383656.608144:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608180:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985027712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.608203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608219:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985028224:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.608235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608248:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206985028736:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.608266:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608275:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787383656.608280:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985027840:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.608298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.608318:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985028352:0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.608321:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028608 00000100:00100000:1.0:1787383656.608327:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028608 00000100:00100000:3.0:1787383656.608339:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383656.608345:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028736 00000100:00100000:1.0:1787383656.608349:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028736 00000100:00100000:3.0:1787383656.608356:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206985028864:0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.608374:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787383656.608381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383656.608387:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985027968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.608405:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027456 00000100:00100000:3.0:1787383656.608410:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027456 00000100:00100000:3.0:1787383656.608440:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787383656.608447:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3649:x1874206985027456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.608454:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985027968:12345-0@lo:400:kworker.0 Request processed in 68us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383656.608464:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787383656.608486:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028864 00000100:00100000:3.0:1787383656.608487:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3649:x1874206985027456:12345-0@lo:400:kworker.0 Request processed in 38us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383656.608491:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028864 00000100:00100000:3.0:1787383656.608497:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787383656.608518:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787383656.608528:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985028480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.608533:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787383656.608544:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206985028992:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1787383656.609002:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383656.614819:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206985028992:12345-0@lo:400:kworker.0 Request processed in 6269us (6851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.614833:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787383656.614928:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985028480:12345-0@lo:400:kworker.0 Request processed in 6399us (7013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383656.614937:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787383656.614968:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383656.614983:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787383656.614995:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.614996:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206985028736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.615061:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206985028736:12345-0@lo:400:kworker.0 Request processed in 70us (6793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383656.615068:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985028608:12345-0@lo:400:kworker.0 Request processed in 81us (6951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383656.615069:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787383656.615080:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787383656.615087:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787383656.615096:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206985028864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.615142:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027584 00000100:00100000:3.0:1787383656.615150:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027584 00000100:00100000:3.0:1787383656.615188:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028096 00000100:00100000:3.0:1787383656.615192:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028096 00000100:00100000:3.0:1787383656.615207:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383656.615214:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985027584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383656.615232:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206985028864:12345-0@lo:400:kworker.0 Request processed in 137us (6850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383656.615239:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787383656.615260:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985027584:12345-0@lo:400:kworker.0 Request processed in 46us (7237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.615267:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383656.615282:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383656.615300:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985028096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.615328:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985028096:12345-0@lo:400:kworker.0 Request processed in 41us (7263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.615334:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787383656.615356:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029120 00000100:00100000:3.0:1787383656.615360:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029120 00000100:00100000:3.0:1787383656.615396:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383656.615403:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985029120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383656.615424:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383656.615453:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985029120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (7308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.615460:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383656.615480:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027712 00000100:00100000:3.0:1787383656.615483:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027712 00000100:00100000:3.0:1787383656.615507:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028224 00000100:00100000:3.0:1787383656.615509:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028224 00000100:00100000:3.0:1787383656.615520:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985027840 00000100:00100000:3.0:1787383656.615523:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985027840 00000100:00100000:3.0:1787383656.615546:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985028352 00000100:00100000:3.0:1787383656.615549:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985028352 00000100:00100000:3.0:1787383656.615560:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383656.615566:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985027712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.615598:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985027712:12345-0@lo:400:kworker.0 Request processed in 32us (7393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.615605:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787383656.615615:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383656.615620:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.615644:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985028224:12345-0@lo:400:kworker.0 Request processed in 24us (7408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.615650:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787383656.615659:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787383656.615665:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206985027840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383656.615722:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787383656.615730:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985028352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383656.615762:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985028352:12345-0@lo:400:kworker.0 Request processed in 33us (7423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383656.615783:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787383656.615994:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1874206985027840:12345-0@lo:400:kworker.0 Request processed in 328us (7694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383656.616000:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787383656.616019:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383656.616023:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787383656.616025:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383656.616027:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383656.616099:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985029376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383656.616132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.616195:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787383656.616203:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985029248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383656.616226:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383656.616382:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985027840:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.616406:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985028352:0@lo:400:kworker.0 00010000:00080000:3.0:1787383656.616420:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e92d80 x1874206985028864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383656.616431:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206985028864:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.616441:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985027712:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.616451:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985028224:0@lo:400:kworker.0 00010000:00080000:3.0:1787383656.616461:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e92a00 x1874206985028736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383656.616469:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206985028736:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.616509:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985027584:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.616519:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985028096:0@lo:400:kworker.0 00000100:00100000:0.0:1787383656.616535:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029376 00000100:00100000:1.0:1787383656.616537:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029248 00000100:00100000:0.0:1787383656.616540:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029376 00000100:00100000:1.0:1787383656.616544:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029248 00000100:00100000:0.0:1787383656.616568:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383656.616576:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985029376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383656.616589:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383656.616628:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985029376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383656.616634:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787383656.616649:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787383656.616655:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985029248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787383656.616664:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383656.616668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985029376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383656.616725:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985029248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383656.616731:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787383656.616762:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985029248:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787383656.616851:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504693100 x1874206985028608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383656.617066:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985028608:0@lo:400:kworker.0 00000100:00100000:3.0:1787383656.617084:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985029120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383656.617094:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3649:1874206985027456:0@lo:400:kworker.0 00010000:00080000:3.0:1787383656.617105:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504693480 x1874206985027968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383656.617113:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985027968:0@lo:400:kworker.0 00010000:00080000:3.0:1787383656.617125:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504690a80 x1874206985028480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383656.617141:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985028480:0@lo:400:kworker.0 00010000:00080000:3.0:1787383656.617154:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503e93800 x1874206985028992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383656.617162:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503e93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206985028992:0@lo:400:kworker.0 00000020:00000004:0.0:1787383656.707848:0:25443:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787383656.708386:0:25443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787383657.013554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.013658:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038272 00000100:00100000:0.0:1787383657.013667:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038272 00000100:00100000:0.0:1787383657.013719:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:0.0:1787383657.013727:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2400:x1874206966038272:12345-192.168.203.2@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787383657.013754:0:22652:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from edeae43f-301c-483b-b410-d06772b42fd6@192.168.203.2@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:0.0:1787383657.013819:0:22652:0:(genops.c:1406:class_connect()) connect: client edeae43f-301c-483b-b410-d06772b42fd6, cookie 0xc40acec91533036c 00000100:00080000:0.0:1787383657.013971:0:22652:0:(import.c:65:import_set_state_nolock()) ffff9636372bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383657.014304:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+5:2400:x1874206966038272:12345-192.168.203.2@tcp:250:mount.lustre.0 Request processed in 575us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383657.014312:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 114 00000100:00100000:3.0:1787383657.020041:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.020191:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038400 00000100:00100000:0.0:1787383657.020205:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038400 00000100:00100000:0.0:1787383657.020322:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:0.0:1787383657.020334:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+5:18060:x1874206966038400:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787383657.020355:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383657.020444:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963610f16400/0xc40acec915330373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c6d expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.020481:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f16400/0xc40acec915330373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c6d expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.020497:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963610f16400/0xc40acec915330373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c6d expref: 6 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.020531:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16400, rc 0) 00000100:00100000:0.0:1787383657.020682:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+6:18060:x1874206966038400:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 342us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383657.020691:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 115 00000100:00100000:1.0:1787383657.025533:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.025866:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038528 00000100:00100000:0.0:1787383657.025878:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038528 00000100:00100000:0.0:1787383657.025979:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:0.0:1787383657.025991:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+6:18060:x1874206966038528:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383657.026148:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+6:18060:x1874206966038528:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 159us (628us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787383657.026157:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 116 00000100:00100000:1.0:1787383657.036134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.036640:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038656 00000100:00100000:0.0:1787383657.036656:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038656 00000100:00100000:0.0:1787383657.036758:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:0.0:1787383657.036813:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+6:18060:x1874206966038656:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787383657.036837:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383657.036862:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963610f17400/0xc40acec91533037a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402c74 expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.036897:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963610f17400/0xc40acec91533037a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c74 expref: 7 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.036910:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963610f17400/0xc40acec91533037a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402c74 expref: 7 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.036920:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17400, rc 0) 00000100:00100000:0.0:1787383657.037006:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+7:18060:x1874206966038656:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 238us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383657.037014:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 117 00000100:00100000:3.0:1787383657.040888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.041246:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038784 00000100:00100000:0.0:1787383657.041261:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038784 00000100:00100000:0.0:1787383657.041362:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:0.0:1787383657.041381:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+7:18060:x1874206966038784:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383657.041604:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+8:18060:x1874206966038784:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 223us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383657.041621:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 118 00000100:00100000:3.0:1787383657.050062:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.050503:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966038912 00000100:00100000:2.0:1787383657.050533:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966038912 00000100:00100000:2.0:1787383657.050997:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:2.0:1787383657.051019:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+8:18060:x1874206966038912:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787383657.051507:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+8:18060:x1874206966038912:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 483us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.051517:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 119 00000100:00100000:1.0:1787383657.063349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.068039:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039040 00000100:00100000:0.0:1787383657.068062:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039040 00000100:00100000:1.0:1787383657.069095:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:1.0:1787383657.069110:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+8:18079:x1874206966039040:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383657.069825:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+8:18079:x1874206966039040:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 712us (6482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.069837:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 120 00000100:00100000:3.0:1787383657.099875:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.100278:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039168 00000100:00100000:2.0:1787383657.100292:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039168 00000100:00100000:2.0:1787383657.100425:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:2.0:1787383657.100438:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+8:18079:x1874206966039168:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383657.100637:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+8:18079:x1874206966039168:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 201us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.100647:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 121 00000100:00100000:3.0:1787383657.108286:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383657.108421:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039296 00000100:00100000:1.0:1787383657.108435:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039296 00000100:00100000:1.0:1787383657.108514:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:1.0:1787383657.108542:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+8:18079:x1874206966039296:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383657.108745:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+8:18079:x1874206966039296:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 204us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.108755:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 122 00000100:00100000:1.0:1787383657.112650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.113064:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039424 00000100:00100000:2.0:1787383657.113078:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039424 00000100:00100000:2.0:1787383657.113145:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:2.0:1787383657.113154:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+8:18060:x1874206966039424:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383657.113168:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383657.113184:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f6e00/0xc40acec915330381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402ca5 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383657.113211:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f6e00/0xc40acec915330381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ca5 expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383657.113222:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f6e00/0xc40acec915330381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ca5 expref: 9 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383657.113246:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6e00, rc 0) 00000100:00100000:2.0:1787383657.113305:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+9:18060:x1874206966039424:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 152us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.113312:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 123 00000100:00100000:3.0:1787383657.116018:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635031f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985029504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383657.116110:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383657.116236:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029504 00000100:00100000:1.0:1787383657.116246:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029504 00000100:00100000:1.0:1787383657.116309:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787383657.116322:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985029504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383657.116367:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787383657.116428:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985029504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.116438:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787383657.116516:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635031f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985029504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383657.117149:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985029632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383657.117198:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383657.117344:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029632 00000100:00100000:1.0:1787383657.117352:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029632 00000100:00100000:1.0:1787383657.117400:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787383657.117408:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985029632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383657.117437:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787383657.117622:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985029632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 214us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.117631:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787383657.117879:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985029632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383657.119898:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383657.121336:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039552 00000100:00100000:1.0:1787383657.121354:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039552 00000100:00100000:1.0:1787383657.121563:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:1.0:1787383657.121575:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+9:18060:x1874206966039552:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787383657.121665:0:22652:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787383657.121715:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787383657.121720:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787383657.121723:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787383657.121726:0:22652:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787383657.121729:0:22652:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000001:00080000:0.0:1787383657.124292:0:24982:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:1.0:1787383657.125911:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+9:18060:x1874206966039552:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 4322us (6010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.125931:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 124 00000100:00100000:3.0:1787383657.128450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.128607:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039680 00000100:00100000:2.0:1787383657.128859:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039680 00000100:00100000:2.0:1787383657.128938:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:2.0:1787383657.128949:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+9:18060:x1874206966039680:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787383657.128973:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383657.128997:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402cac expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383657.129171:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383657.129186:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 10 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383657.129197:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6c00, rc 0) 00000100:00100000:2.0:1787383657.129321:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+10:18060:x1874206966039680:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 373us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.129329:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 125 00000100:00100000:3.0:1787383657.131601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383657.134809:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039808 00000100:00100000:1.0:1787383657.134830:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039808 00000100:00100000:1.0:1787383657.134922:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:1.0:1787383657.134934:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+10:18060:x1874206966039808:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787383657.135250:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+10:18060:x1874206966039808:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 316us (3661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.135259:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 126 00000100:00100000:3.0:1787383657.137947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.138162:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966039936 00000100:00100000:2.0:1787383657.138177:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966039936 00000100:00100000:2.0:1787383657.138251:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:2.0:1787383657.138277:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+10:18060:x1874206966039936:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787383657.138485:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+10:18060:x1874206966039936:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 210us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.138668:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 127 00000100:00100000:3.0:1787383657.149400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383657.149479:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040064 00000100:00100000:1.0:1787383657.149615:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040064 00000100:00100000:1.0:1787383657.149763:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:1.0:1787383657.149826:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+10:18083:x1874206966040064:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383657.150049:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+10:18083:x1874206966040064:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 226us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.150057:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 128 00000100:00100000:3.0:1787383657.152978:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.153172:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040192 00000100:00100000:2.0:1787383657.153185:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040192 00000100:00100000:2.0:1787383657.153261:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:2.0:1787383657.153272:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+10:18083:x1874206966040192:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383657.153479:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+10:18083:x1874206966040192:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 208us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.153488:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 129 00000100:00100000:3.0:1787383657.160661:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383657.160725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383657.161111:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040320 00000100:00100000:1.0:1787383657.161126:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040320 00000100:00100000:1.0:1787383657.161172:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040576 00000100:00100000:1.0:1787383657.161175:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040576 00000100:00100000:1.0:1787383657.161207:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:1.0:1787383657.161217:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2400:x1874206966040320:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787383657.161273:0:22659:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f20c8c43-0216-4a1c-8d1c-d6c7feee2f60@192.168.203.2@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1787383657.161337:0:22659:0:(genops.c:1406:class_connect()) connect: client f20c8c43-0216-4a1c-8d1c-d6c7feee2f60, cookie 0xc40acec91533038f 00000004:00100000:1.0:1787383657.161372:0:22659:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787383657.161642:0:22659:0:(import.c:65:import_set_state_nolock()) ffff96350377e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383657.161801:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:0.0:1787383657.161809:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874206966040576:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787383657.161831:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from f20c8c43-0216-4a1c-8d1c-d6c7feee2f60@192.168.203.2@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:0.0:1787383657.161867:0:22660:0:(genops.c:1406:class_connect()) connect: client f20c8c43-0216-4a1c-8d1c-d6c7feee2f60, cookie 0xc40acec915330396 00000004:00100000:0.0:1787383657.161882:0:22660:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787383657.161950:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2400:x1874206966040320:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 733us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.161959:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00080000:0.0:1787383657.162033:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9636372b9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787383657.162061:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2400:x1874206966040576:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 251us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383657.162069:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1787383657.164965:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383657.165040:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383657.165127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.165493:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040704 00000100:00100000:2.0:1787383657.165506:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040704 00000100:00100000:2.0:1787383657.165585:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040448 00000100:00100000:2.0:1787383657.165588:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040448 00000100:00100000:2.0:1787383657.165619:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040832 00000100:00100000:2.0:1787383657.165622:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040832 00000100:00100000:2.0:1787383657.165644:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1787383657.165655:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:0:x1874206966040704:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383657.165704:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383657.165855:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:0:x1874206966040704:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 200us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.165863:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:2.0:1787383657.165885:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383657.165892:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:0:x1874206966040448:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383657.165916:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383657.165956:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:0:x1874206966040448:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 64us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.165963:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383657.165977:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:2.0:1787383657.165984:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966040832:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787383657.165995:0:22660:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383657.166017:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966040832:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 33us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.166023:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00080000:3.0:1787383657.167283:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383657.167294:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383657.169314:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.169479:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966040960 00000100:00100000:2.0:1787383657.169492:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966040960 00000100:00100000:2.0:1787383657.169642:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1787383657.169655:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966040960:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787383657.169824:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503d43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966040960:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 171us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.169832:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1787383657.174368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.174422:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383657.174515:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383657.175587:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041344 00000100:00100000:1.0:1787383657.175602:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041344 00000100:00100000:1.0:1787383657.175717:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1787383657.175731:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966041344:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787383657.175884:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966041344:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 156us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383657.175893:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1787383657.178889:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041088 00000100:00100000:3.0:1787383657.178909:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041088 00000100:00100000:2.0:1787383657.179284:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041216 00000100:00100000:2.0:1787383657.179289:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041216 00000100:00100000:2.0:1787383657.179332:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383657.179342:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206966041088:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787383657.179390:0:24169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f20c8c43-0216-4a1c-8d1c-d6c7feee2f60@192.168.203.2@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1787383657.179455:0:24169:0:(genops.c:1406:class_connect()) connect: client f20c8c43-0216-4a1c-8d1c-d6c7feee2f60, cookie 0xc40acec91533039d 00002000:00100000:2.0:1787383657.179472:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f20c8c43-0216-4a1c-8d1c-d6c7feee2f60/ffff96350233c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383657.179515:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383657.179802:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383657.179848:0:24169:0:(import.c:65:import_set_state_nolock()) ffff96350233f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383657.179938:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2400:x1874206966041088:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 596us (5588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.179947:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383657.179971:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383657.179976:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206966041216:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787383657.179997:0:24169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f20c8c43-0216-4a1c-8d1c-d6c7feee2f60@192.168.203.2@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1787383657.180020:0:24169:0:(genops.c:1406:class_connect()) connect: client f20c8c43-0216-4a1c-8d1c-d6c7feee2f60, cookie 0xc40acec9153303a4 00002000:00100000:2.0:1787383657.180027:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f20c8c43-0216-4a1c-8d1c-d6c7feee2f60/ffff963503413000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383657.180034:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383657.180159:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787383657.180176:0:24169:0:(import.c:65:import_set_state_nolock()) ffff963503416000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383657.180201:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362d919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2400:x1874206966041216:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 224us (5779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383657.180207:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383657.181456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383657.181815:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041472 00000100:00100000:3.0:1787383657.181826:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041472 00000100:00100000:3.0:1787383657.181888:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1787383657.181899:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966041472:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787383657.188837:0:22662:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6837us 00000004:00200000:3.0:1787383657.213427:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787383657.213862:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18060:x1874206966041472:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 31956us (32404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383657.213876:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383657.353368:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383657.353517:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041600 00000100:00100000:0.0:1787383657.353530:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041600 00000100:00100000:0.0:1787383657.353741:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:0.0:1787383657.353755:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18106:x1874206966041600:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:0.0:1787383657.353834:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383657.353877:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec9153303ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402cdd expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.353961:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec9153303b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.353977:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec9153303b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.353993:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec9153303b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383657.354057:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383657.354061:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383657.354098:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec9153303b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.354127:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec9153303ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cdd expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.354148:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec9153303b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cdd expref: 7 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383657.354158:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:0.0:1787383657.354162:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383657.354165:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16000, rc 0) 00000100:00100000:0.0:1787383657.354246:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18106:x1874206966041600:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 494us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383657.360154:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00010000:00010000:0.0:1787383657.627061:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383658.654961:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383658.977370:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787383659.427923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.428007:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041728 00000100:00100000:0.0:1787383659.428015:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041728 00000100:00080000:3.0:1787383659.428108:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383659.428137:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:0.0:1787383659.428147:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18158:x1874206966041728:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:0.0:1787383659.428177:0:23412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787383659.428244:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18158:x1874206966041728:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 100us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.428249:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383659.430958:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.431157:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041856 00000100:00100000:1.0:1787383659.431172:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041856 00000100:00100000:1.0:1787383659.431298:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:1.0:1787383659.431308:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18158:x1874206966041856:12345-192.168.203.2@tcp:41:lfs.0 00000004:00000024:1.0:1787383659.431365:0:22659:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1787383659.431441:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787383659.431484:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18158:x1874206966041856:12345-192.168.203.2@tcp:41:lfs.0 Request processed in 178us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.431497:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:3.0:1787383659.433618:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.433993:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966041984 00000100:00100000:1.0:1787383659.434001:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966041984 00000100:00100000:1.0:1787383659.434093:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:1.0:1787383659.434103:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18158:x1874206966041984:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:1.0:1787383659.434143:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1787383659.434205:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383659.434252:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18158:x1874206966041984:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 143us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.434260:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383659.435333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.435412:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042112 00000100:00100000:0.0:1787383659.435418:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042112 00000100:00100000:0.0:1787383659.435474:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00080000:3.0:1787383659.435563:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383659.435590:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18158:x1874206966042112:12345-192.168.203.2@tcp:13:lfs.0 00002000:00000024:0.0:1787383659.435623:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383659.435845:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18158:x1874206966042112:12345-192.168.203.2@tcp:13:lfs.0 Request processed in 361us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.435853:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383659.664733:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.666153:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042240 00000100:00100000:1.0:1787383659.666167:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042240 00000100:00100000:1.0:1787383659.666234:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 130 00000100:00100000:1.0:1787383659.666243:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+10:18190:x1874206966042240:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383659.666257:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383659.666274:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963605828800/0xc40acec9153303b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402ce4 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.666302:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963605828800/0xc40acec9153303b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ce4 expref: 11 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.666312:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963605828800/0xc40acec9153303b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402ce4 expref: 11 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.666321:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828800, rc 0) 00000100:00100000:1.0:1787383659.666388:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635287c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+11:18190:x1874206966042240:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 145us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.666394:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 130 00010000:00010000:0.0:1787383659.680166:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383659.686396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.689749:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042368 00000100:00100000:0.0:1787383659.689790:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042368 00000100:00100000:0.0:1787383659.689862:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:0.0:1787383659.689873:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+11:18190:x1874206966042368:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787383659.690052:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+11:18190:x1874206966042368:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 180us (3663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.690061:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 131 00000100:00100000:3.0:1787383659.697472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.697976:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042496 00000100:00100000:2.0:1787383659.697987:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042496 00000100:00100000:2.0:1787383659.698062:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:2.0:1787383659.698072:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+11:18190:x1874206966042496:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787383659.698210:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635286850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+11:18190:x1874206966042496:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 138us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.698218:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 132 00000100:00100000:2.0:1787383659.709479:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.709708:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042624 00000100:00100000:1.0:1787383659.709719:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042624 00000100:00100000:1.0:1787383659.709810:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:1.0:1787383659.709820:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+11:18197:x1874206966042624:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787383659.710002:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+11:18197:x1874206966042624:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 183us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.710010:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 133 00000100:00100000:3.0:1787383659.742212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.742310:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042752 00000100:00100000:0.0:1787383659.742333:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042752 00000100:00100000:0.0:1787383659.742388:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:0.0:1787383659.742398:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+11:18197:x1874206966042752:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383659.742550:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635287450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+11:18197:x1874206966042752:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.742559:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 134 00000100:00100000:3.0:1787383659.748249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.748564:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966042880 00000100:00100000:2.0:1787383659.748574:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966042880 00000100:00100000:2.0:1787383659.748641:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1787383659.748651:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+11:18197:x1874206966042880:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383659.748848:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635285850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+11:18197:x1874206966042880:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 198us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.748857:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 135 00000100:00100000:2.0:1787383659.757888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.757995:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043008 00000100:00100000:1.0:1787383659.758005:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043008 00000100:00100000:1.0:1787383659.758060:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:1.0:1787383659.758070:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+11:18190:x1874206966043008:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383659.758086:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383659.758278:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963605828600/0xc40acec9153303c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d15 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.758306:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963605828600/0xc40acec9153303c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d15 expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.758317:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963605828600/0xc40acec9153303c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d15 expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.758326:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828600, rc 0) 00000100:00100000:1.0:1787383659.758431:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635284450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+12:18190:x1874206966043008:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 362us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.758438:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 136 00000100:00100000:3.0:1787383659.768200:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.768460:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043136 00000100:00100000:2.0:1787383659.768470:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043136 00000100:00100000:2.0:1787383659.768528:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:2.0:1787383659.768538:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963635286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+12:18190:x1874206966043136:12345-192.168.203.2@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787383659.768563:0:22654:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787383659.768582:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787383659.768586:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787383659.768589:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787383659.768592:0:22654:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787383659.768594:0:22654:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1787383659.772022:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963635286050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+12:18190:x1874206966043136:12345-192.168.203.2@tcp:256:mount.lustre.0 Request processed in 3476us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.772050:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 137 00000100:00100000:3.0:1787383659.776293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.776750:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043264 00000100:00100000:1.0:1787383659.776761:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043264 00000100:00100000:1.0:1787383659.776843:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:1.0:1787383659.776853:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963618030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+12:18190:x1874206966043264:12345-192.168.203.2@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787383659.776870:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383659.776903:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d1c expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.776933:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 13 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.777108:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 13 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383659.777119:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828000, rc 0) 00000100:00100000:1.0:1787383659.777180:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963618030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+13:18190:x1874206966043264:12345-192.168.203.2@tcp:101:mount.lustre.0 Request processed in 328us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.777188:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 138 00000100:00100000:3.0:1787383659.781573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.781846:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043392 00000100:00100000:2.0:1787383659.781856:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043392 00000100:00100000:2.0:1787383659.781911:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:2.0:1787383659.781921:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963618031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18190:x1874206966043392:12345-192.168.203.2@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787383659.782196:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963618031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18190:x1874206966043392:12345-192.168.203.2@tcp:501:mount.lustre.0 Request processed in 276us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.782204:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 139 00000100:00100000:3.0:1787383659.784382:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.784478:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043520 00000100:00100000:1.0:1787383659.784487:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043520 00000100:00100000:1.0:1787383659.784535:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:1.0:1787383659.784544:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+13:18190:x1874206966043520:12345-192.168.203.2@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787383659.785271:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+13:18190:x1874206966043520:12345-192.168.203.2@tcp:503:mount.lustre.0 Request processed in 726us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383659.785280:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 140 00000100:00100000:3.0:1787383659.788610:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.789326:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043648 00000100:00100000:2.0:1787383659.789335:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043648 00000100:00100000:2.0:1787383659.789448:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:2.0:1787383659.789458:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18199:x1874206966043648:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787383659.789594:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18199:x1874206966043648:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 136us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.789611:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 141 00000100:00100000:3.0:1787383659.796078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.804541:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043776 00000100:00100000:0.0:1787383659.804555:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043776 00000100:00100000:0.0:1787383659.804624:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:0.0:1787383659.804634:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+13:18199:x1874206966043776:12345-192.168.203.2@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787383659.804827:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+13:18199:x1874206966043776:12345-192.168.203.2@tcp:502:llog_process_th.0 Request processed in 193us (8756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.804835:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 142 00000100:00100000:0.0:1787383659.809365:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.809406:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.809488:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966043904 00000100:00100000:2.0:1787383659.809497:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966043904 00000100:00100000:2.0:1787383659.809540:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044160 00000100:00100000:2.0:1787383659.809544:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044160 00000100:00100000:2.0:1787383659.809565:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383659.809573:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874206966043904:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383659.809612:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8056f36d-71ba-4e9d-a187-445657578982@192.168.203.2@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1787383659.809651:0:22660:0:(genops.c:1406:class_connect()) connect: client 8056f36d-71ba-4e9d-a187-445657578982, cookie 0xc40acec9153303ce 00000004:00100000:2.0:1787383659.809682:0:22660:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787383659.809795:0:22660:0:(import.c:65:import_set_state_nolock()) ffff96363d95e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383659.809866:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8056f36d-71ba-4e9d-a187-445657578982+6:2400:x1874206966043904:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 292us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.809873:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:2.0:1787383659.809891:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:2.0:1787383659.809895:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1874206966044160:12345-192.168.203.2@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787383659.809910:0:22660:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 8056f36d-71ba-4e9d-a187-445657578982@192.168.203.2@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1787383659.809932:0:22660:0:(genops.c:1406:class_connect()) connect: client 8056f36d-71ba-4e9d-a187-445657578982, cookie 0xc40acec9153303d5 00000004:00100000:2.0:1787383659.810147:0:22660:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787383659.810194:0:22660:0:(import.c:65:import_set_state_nolock()) ffff9636356fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383659.810217:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8056f36d-71ba-4e9d-a187-445657578982+6:2400:x1874206966044160:12345-192.168.203.2@tcp:38:mount.lustre.0 Request processed in 320us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.810223:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:1.0:1787383659.817441:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.817486:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.817581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.817897:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044416 00000100:00100000:0.0:1787383659.817906:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044416 00000100:00100000:0.0:1787383659.817972:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044288 00000100:00100000:0.0:1787383659.817976:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044288 00000100:00100000:0.0:1787383659.817992:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044032 00000100:00100000:0.0:1787383659.817995:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044032 00000100:00100000:0.0:1787383659.818010:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383659.818017:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+7:18190:x1874206966044416:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383659.818046:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787383659.818101:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+7:18190:x1874206966044416:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 84us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.818109:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383659.818139:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383659.818145:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:0:x1874206966044288:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383659.818157:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383659.818183:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:0:x1874206966044288:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 38us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.818190:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383659.818202:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1787383659.818208:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:0:x1874206966044032:12345-192.168.203.2@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787383659.818219:0:22661:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787383659.818241:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:0:x1874206966044032:12345-192.168.203.2@tcp:41:mount.lustre.0 Request processed in 33us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.818247:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00080000:1.0:1787383659.818647:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787383659.818651:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383659.823620:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.823967:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044544 00000100:00100000:2.0:1787383659.823977:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044544 00000100:00100000:2.0:1787383659.824036:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:2.0:1787383659.824045:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:18190:x1874206966044544:12345-192.168.203.2@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787383659.824141:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:18190:x1874206966044544:12345-192.168.203.2@tcp:40:mount.lustre.0 Request processed in 97us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.824149:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:1.0:1787383659.828953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.828984:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383659.829006:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383659.829075:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044928 00000100:00100000:0.0:1787383659.829084:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044928 00000100:00100000:0.0:1787383659.829151:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1787383659.829161:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8056f36d-71ba-4e9d-a187-445657578982+6:18190:x1874206966044928:12345-192.168.203.2@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787383659.829234:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8056f36d-71ba-4e9d-a187-445657578982+6:18190:x1874206966044928:12345-192.168.203.2@tcp:900:mount.lustre.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.829246:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:2.0:1787383659.833177:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044672 00000100:00100000:2.0:1787383659.833192:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044672 00000100:00100000:3.0:1787383659.833225:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966044800 00000100:00100000:3.0:1787383659.833231:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966044800 00000100:00100000:2.0:1787383659.833256:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1787383659.833266:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:2.0:1787383659.833267:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2400:x1874206966044672:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787383659.833303:0:24169:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8056f36d-71ba-4e9d-a187-445657578982@192.168.203.2@tcp t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:2.0:1787383659.833333:0:24169:0:(genops.c:1406:class_connect()) connect: client 8056f36d-71ba-4e9d-a187-445657578982, cookie 0xc40acec9153303dc 00002000:00100000:2.0:1787383659.833357:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8056f36d-71ba-4e9d-a187-445657578982/ffff9636356fe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787383659.833367:0:24169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787383659.833424:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787383659.833469:0:24169:0:(import.c:65:import_set_state_nolock()) ffff963637285000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787383659.833534:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8056f36d-71ba-4e9d-a187-445657578982+6:2400:x1874206966044672:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 268us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383659.835161:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2400:x1874206966044800:12345-192.168.203.2@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787383659.835197:0:24167:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8056f36d-71ba-4e9d-a187-445657578982@192.168.203.2@tcp t0 exp 0000000000000000 cur 692 last 0 00000100:00100000:1.0:1787383659.835217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000020:00000080:3.0:1787383659.835226:0:24167:0:(genops.c:1406:class_connect()) connect: client 8056f36d-71ba-4e9d-a187-445657578982, cookie 0xc40acec9153303e3 00002000:00100000:3.0:1787383659.835250:0:24167:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8056f36d-71ba-4e9d-a187-445657578982/ffff963637276800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113672 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787383659.835260:0:24167:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787383659.835327:0:24167:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787383659.835359:0:24167:0:(import.c:65:import_set_state_nolock()) ffff963637273800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787383659.835415:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8056f36d-71ba-4e9d-a187-445657578982+6:2400:x1874206966044800:12345-192.168.203.2@tcp:8:mount.lustre.0 Request processed in 262us (6405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.835585:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045056 00000100:00100000:0.0:1787383659.835592:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045056 00000100:00100000:0.0:1787383659.835637:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1787383659.835644:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8056f36d-71ba-4e9d-a187-445657578982+6:18190:x1874206966045056:12345-192.168.203.2@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787383659.835863:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787383659.835930:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8056f36d-71ba-4e9d-a187-445657578982+6:18190:x1874206966045056:12345-192.168.203.2@tcp:33:mount.lustre.0 Request processed in 286us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383659.835938:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:2.0:1787383659.836836:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:3.0:1787383659.837031:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:1.0:1787383659.986218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383659.987907:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045184 00000100:00100000:2.0:1787383659.987919:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045184 00000100:00100000:2.0:1787383659.987990:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:2.0:1787383659.987999:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8056f36d-71ba-4e9d-a187-445657578982+6:18222:x1874206966045184:12345-192.168.203.2@tcp:101:mkdir.0 00010000:00010000:2.0:1787383659.988018:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383659.988042:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7c00/0xc40acec9153303ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d4d expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383659.988102:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383659.988114:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383659.988128:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383659.988174:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787383659.988179:0:23412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383659.988198:0:23412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383659.988240:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7c00/0xc40acec9153303ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 8 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383659.988259:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 7 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383659.988268:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:2.0:1787383659.988270:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787383659.988274:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7600, rc 0) 00000100:00100000:2.0:1787383659.988337:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8056f36d-71ba-4e9d-a187-445657578982+7:18222:x1874206966045184:12345-192.168.203.2@tcp:101:mkdir.0 Request processed in 338us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383659.988344:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:3.0:1787383660.703418:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985029760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383660.703499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383660.706259:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029760 00000100:00100000:0.0:1787383660.706272:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029760 00000100:00100000:0.0:1787383660.707398:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383660.707410:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985029760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383660.707436:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00010000:00010000:3.0:1787383660.707782:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383660.707863:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985029760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 455us (4372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383660.707871:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787383660.707968:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363692aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985029760:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787383660.711284:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383661.723211:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985029888:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787383661.723252:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383661.723276:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985030144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383661.723299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.723387:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985030016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383661.726051:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985029888 00000100:00100000:0.0:1787383661.726065:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985029888 00000100:00100000:0.0:1787383661.726149:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787383661.726166:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985029888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787383661.726208:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383661.726516:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.726625:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985030656:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.726686:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.726721:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206985031168:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.726749:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.726789:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206985031680:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.726812:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.726833:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787383661.726841:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985030528:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.726864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.726889:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985031040:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.726910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.726929:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206985031552:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.726951:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.727023:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031168 00000100:00100000:3.0:1787383661.727028:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031168 00000100:00100000:3.0:1787383661.727067:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031680 00000100:00100000:3.0:1787383661.727069:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031680 00000100:00100000:3.0:1787383661.727085:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031552 00000100:00100000:3.0:1787383661.727087:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031552 00000100:00100000:3.0:1787383661.727105:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383661.727111:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206985031168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727158:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206985031168:12345-0@lo:400:kworker.0 Request processed in 46us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.727165:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787383661.727184:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383661.727188:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206985031680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727228:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206985031680:12345-0@lo:400:kworker.0 Request processed in 39us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.727233:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787383661.727244:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383661.727248:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206985031552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727266:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874206985031552:12345-0@lo:400:kworker.0 Request processed in 18us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.727271:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787383661.727324:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1874206985031552:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727348:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206985031168:0@lo:400:kworker.0 00010000:00080000:3.0:1787383661.727362:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da08000 x1874206985031680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383661.727372:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206985031680:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727427:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030656 00000100:00100000:3.0:1787383661.727430:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030656 00000100:00100000:3.0:1787383661.727463:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030528 00000100:00100000:3.0:1787383661.727466:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030528 00000100:00100000:3.0:1787383661.727483:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031040 00000100:00100000:3.0:1787383661.727485:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031040 00000100:00100000:3.0:1787383661.727498:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383661.727504:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985030656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727540:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985030656:12345-0@lo:400:kworker.0 Request processed in 36us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.727546:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787383661.727556:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383661.727569:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985030528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727598:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985030528:12345-0@lo:400:kworker.0 Request processed in 31us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.727605:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787383661.727616:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383661.727620:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985031040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.727662:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985031040:12345-0@lo:400:kworker.0 Request processed in 42us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.727670:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787383661.727691:0:24170:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787383661.727700:0:24170:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00080000:3.0:1787383661.727725:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787383661.727731:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383661.727734:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787383661.727736:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787383661.727755:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985030272:0@lo:400:kworker.0 00000100:00100000:2.0:1787383661.727803:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.727941:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985030528:0@lo:400:kworker.0 00000100:00100000:2.0:1787383661.727955:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985031040:0@lo:400:kworker.0 00000100:00100000:2.0:1787383661.727965:0:3650:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787383661.727980:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985030656:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.728080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383661.728145:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985030784:0@lo:400:kworker.0 00000100:00100000:2.0:1787383661.728146:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030272 00000100:00100000:2.0:1787383661.728158:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030272 00000100:00100000:1.0:1787383661.728158:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985030400:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.728196:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.728210:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787383661.728213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.728222:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985030272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.728231:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206985031296:0@lo:400:kworker.0 00000100:00100000:1.0:1787383661.728263:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985030912:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.728288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.728296:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985030272:12345-0@lo:400:kworker.0 Request processed in 73us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383661.728305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.728317:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787383661.728339:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206985031424:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.729010:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985030272:0@lo:400:kworker.0 00000100:00100000:1.0:1787383661.729050:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383661.729055:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030784 00000100:00100000:2.0:1787383661.729062:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030784 00000100:00100000:3.0:1787383661.729187:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031296 00000100:00100000:2.0:1787383661.729188:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031424 00000100:00100000:1.0:1787383661.729195:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787383661.729199:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031296 00000100:00100000:2.0:1787383661.729200:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031424 00000100:00100000:1.0:1787383661.729207:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985030784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383661.729278:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1874206985030784:12345-0@lo:400:kworker.0 Request processed in 72us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.729287:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787383661.729298:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787383661.729307:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206985031296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383661.729311:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787383661.729318:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206985031424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383661.729346:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030400 00000100:00100000:1.0:1787383661.729351:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030400 00000100:00100000:2.0:1787383661.729357:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1874206985031424:12345-0@lo:400:kworker.0 Request processed in 48us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383661.729363:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787383661.729373:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030912 00000100:00100000:1.0:1787383661.729375:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030912 00000100:00100000:2.0:1787383661.729382:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030144 00000100:00100000:2.0:1787383661.729385:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030144 00000100:00100000:1.0:1787383661.729389:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383661.729394:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985030400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383661.729401:0:24170:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787383661.729407:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985030016 00000100:00100000:2.0:1787383661.729410:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985030016 00000100:00100000:1.0:1787383661.729422:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985030400:12345-0@lo:400:kworker.0 Request processed in 28us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383661.729427:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787383661.729439:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383661.729486:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383661.729493:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985030144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787383661.729507:0:25506:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787383661.729551:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985030144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (3027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383661.729554:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985030912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383661.729557:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787383661.729591:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985030144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383661.729597:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985030912:12345-0@lo:400:kworker.0 Request processed in 46us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383661.729602:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787383661.729612:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787383661.729618:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985030016:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383661.729631:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1874206985030784:0@lo:400:kworker.0 00002000:00000024:2.0:1787383661.729634:0:25506:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383661.729676:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985030016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383661.729687:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787383661.729687:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985030400:0@lo:400:kworker.0 00000100:00100000:1.0:1787383661.729696:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985030912:0@lo:400:kworker.0 00010000:00080000:1.0:1787383661.729707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362da0bb80 x1874206985031424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383661.729711:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985030016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787383661.729718:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1874206985031424:0@lo:400:kworker.0 00000100:00080000:2.0:1787383661.729738:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383661.729742:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383661.732672:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206985031296:0@lo:400:kworker.0 00000100:00100000:3.0:1787383661.734163:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206985031296:12345-0@lo:400:kworker.0 Request processed in 3281us (4292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383661.734191:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787383661.735668:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985029888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9497us (12359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383661.735685:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383661.735939:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985029888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383662.239900:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383662.239922:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985031808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383662.239986:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383662.240038:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031808 00000100:00100000:0.0:1787383662.240046:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031808 00000100:00100000:0.0:1787383662.240093:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383662.240102:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985031808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383662.240135:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383662.240186:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985031808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383662.240194:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787383662.240237:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985031808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383662.246901:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787383662.246923:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985031936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383662.246997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383662.249084:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985031936 00000100:00100000:1.0:1787383662.249097:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985031936 00000100:00100000:1.0:1787383662.249149:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383662.249158:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985031936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787383662.249193:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787383662.249258:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985031936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383662.249265:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787383662.250869:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985031936:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1787383662.757149:0:22639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8056f36d-71ba-4e9d-a187-445657578982 00000001:00100000:2.0:1787383662.757163:0:22639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f20c8c43-0216-4a1c-8d1c-d6c7feee2f60 00000001:00100000:1.0:1787383662.757254:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8056f36d-71ba-4e9d-a187-445657578982 00000001:00100000:1.0:1787383662.757262:0:24163:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f20c8c43-0216-4a1c-8d1c-d6c7feee2f60 00010000:00010000:0.0:1787383662.759500:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787383662.760043:0:23393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8056f36d-71ba-4e9d-a187-445657578982 00000001:00100000:0.0:1787383662.760050:0:23393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f20c8c43-0216-4a1c-8d1c-d6c7feee2f60 00000001:00100000:0.0:1787383662.761029:0:24982:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8056f36d-71ba-4e9d-a187-445657578982 00000001:00100000:0.0:1787383662.761037:0:24982:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f20c8c43-0216-4a1c-8d1c-d6c7feee2f60 00000001:02000400:1.0:1787383662.904605:0:25543:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1787383663.003384:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787383663.772100:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383664.796246:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383665.215574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215626:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215681:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215711:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215743:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383665.215788:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045312 00000100:00100000:0.0:1787383665.215796:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045312 00000100:00100000:0.0:1787383665.215839:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1787383665.215848:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+13:2404:x1874206966045312:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383665.215903:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+13:2404:x1874206966045312:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 56us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383665.215917:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 144 00000100:00100000:0.0:1787383665.215945:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045440 00000100:00100000:0.0:1787383665.215948:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045440 00000100:00100000:0.0:1787383665.215972:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045952 00000100:00100000:0.0:1787383665.215974:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045952 00000100:00100000:0.0:1787383665.215984:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045568 00000100:00100000:0.0:1787383665.215986:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045568 00000100:00100000:0.0:1787383665.215996:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046080 00000100:00100000:0.0:1787383665.215998:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046080 00000100:00100000:0.0:1787383665.216009:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1787383665.216015:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2403:x1874206966045440:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383665.216064:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2403:x1874206966045440:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 48us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383665.216071:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:0.0:1787383665.216084:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1787383665.216090:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:2403:x1874206966045952:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383665.216113:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:2403:x1874206966045952:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383665.216119:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1787383665.216130:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:0.0:1787383665.216146:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966045568:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383665.216170:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966045568:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383665.216175:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:0.0:1787383665.216187:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:0.0:1787383665.216199:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966046080:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383665.216223:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966046080:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383665.216230:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:3.0:1787383665.218614:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045696 00000100:00100000:3.0:1787383665.218632:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045696 00000100:00100000:3.0:1787383665.218680:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046208 00000100:00100000:3.0:1787383665.218683:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046208 00000100:00100000:3.0:1787383665.218695:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966045824 00000100:00100000:3.0:1787383665.218697:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966045824 00000100:00100000:3.0:1787383665.218709:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046336 00000100:00100000:3.0:1787383665.218711:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046336 00000100:00100000:3.0:1787383665.218727:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383665.218734:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2403:x1874206966045696:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383665.218806:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2403:x1874206966045696:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 72us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383665.218813:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383665.218827:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1787383665.218833:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8056f36d-71ba-4e9d-a187-445657578982+5:2403:x1874206966046208:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383665.218855:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8056f36d-71ba-4e9d-a187-445657578982+5:2403:x1874206966046208:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383665.218861:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:3.0:1787383665.218869:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383665.218875:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966045824:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383665.218906:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966045824:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 32us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383665.218913:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383665.218924:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1787383665.218930:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966046336:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383665.218948:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966046336:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 19us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383665.218954:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00080000:2.0:1787383665.220979:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383665.220988:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787383665.220991:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787383665.220993:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787383665.827626:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985032064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787383665.827703:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383665.827905:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032064 00000100:00100000:1.0:1787383665.827913:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032064 00000100:00100000:1.0:1787383665.827986:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787383665.827996:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985032064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383665.828023:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383665.828067:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985032064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383665.828075:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787383665.828097:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383665.828131:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985032064:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787383665.828566:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787383666.843021:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787383666.843043:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787383666.843111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383666.843416:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032192 00000100:00100000:0.0:1787383666.843424:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032192 00000100:00100000:0.0:1787383666.843521:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787383666.843532:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985032192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787383666.843568:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787383666.843628:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985032192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383666.843635:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787383666.843660:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383666.845183:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985032320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845267:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985032832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845309:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206985033344:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845333:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845355:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787383666.845361:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985032448:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845380:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845396:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985032960:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845418:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845463:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206985033472:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845494:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845522:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206985032704:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.845541:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.845570:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206985033216:0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.846696:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032320 00000100:00100000:1.0:1787383666.846704:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032320 00000100:00100000:1.0:1787383666.846752:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787383666.846761:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985032320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383666.849533:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985033984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787383666.856997:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985032320:12345-0@lo:400:kworker.0 Request processed in 10227us (11746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.857012:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787383666.860959:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032960 00000100:00100000:1.0:1787383666.860974:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032960 00000100:00100000:1.0:1787383666.861036:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383666.861046:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985032960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861132:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985032960:12345-0@lo:400:kworker.0 Request processed in 88us (15713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861139:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787383666.861161:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032832 00000100:00100000:1.0:1787383666.861175:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032832 00000100:00100000:1.0:1787383666.861201:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032448 00000100:00100000:1.0:1787383666.861204:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032448 00000100:00100000:1.0:1787383666.861216:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383666.861221:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985032832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861255:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985032832:12345-0@lo:400:kworker.0 Request processed in 34us (15964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861262:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383666.861273:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383666.861278:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985032448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861304:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985032448:12345-0@lo:400:kworker.0 Request processed in 25us (15922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861309:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383666.861326:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033344 00000100:00100000:1.0:1787383666.861329:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033344 00000100:00100000:1.0:1787383666.861355:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033472 00000100:00100000:1.0:1787383666.861357:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033472 00000100:00100000:1.0:1787383666.861367:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032704 00000100:00100000:1.0:1787383666.861369:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032704 00000100:00100000:1.0:1787383666.861380:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787383666.861385:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206985033344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861412:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1874206985033344:12345-0@lo:400:kworker.0 Request processed in 27us (16078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861418:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787383666.861426:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383666.861440:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206985033472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861464:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206985033472:12345-0@lo:400:kworker.0 Request processed in 33us (15970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861478:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787383666.861489:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383666.861493:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206985032704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861533:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874206985032704:12345-0@lo:400:kworker.0 Request processed in 38us (15990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861539:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787383666.861577:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985032576:0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861625:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383666.861648:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985033088:0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861666:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383666.861679:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206985033600:0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861698:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383666.861732:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787383666.861756:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033600 00000100:00100000:1.0:1787383666.861759:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033600 00000100:00100000:1.0:1787383666.861796:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383666.861801:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206985033600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.861829:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1874206985033600:12345-0@lo:400:kworker.0 Request processed in 28us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.861835:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787383666.861855:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1874206985033600:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.869805:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383666.870652:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033216 00000100:00100000:1.0:1787383666.870663:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033216 00000100:00100000:1.0:1787383666.870706:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787383666.870721:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206985033216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.870805:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874206985033216:12345-0@lo:400:kworker.0 Request processed in 85us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383666.870815:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787383666.871223:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985033856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383666.871263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.871307:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985032448:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.871321:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985032960:0@lo:400:kworker.0 00010000:00080000:2.0:1787383666.871335:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f35f80 x1874206985033472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383666.871344:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206985033472:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.871354:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985032320:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.871364:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985032832:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.871373:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1874206985033344:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.871409:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033856 00000100:00100000:2.0:1787383666.871413:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033856 00000100:00100000:2.0:1787383666.872329:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383666.872343:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985033856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787383666.872364:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787383666.872417:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985033856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383666.872448:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787383666.872493:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985033856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787383666.872525:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874206985033216:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.872534:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206985033728:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.872681:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383666.872706:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033728 00000100:00100000:2.0:1787383666.872709:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033728 00000100:00100000:2.0:1787383666.872738:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787383666.872744:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206985033728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.872791:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874206985033728:12345-0@lo:400:kworker.0 Request processed in 47us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383666.872798:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787383666.872827:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963503f34000 x1874206985033728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383682 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383666.872837:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1874206985033728:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.872857:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874206985032704:0@lo:400:kworker.0 00000100:00100000:0.0:1787383666.873277:0:24754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985032576 00000100:00100000:0.0:1787383666.873282:0:24754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985032576 00000100:00100000:0.0:1787383666.873308:0:24754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033088 00000100:00100000:0.0:1787383666.873311:0:24754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033088 00000100:00100000:0.0:1787383666.873331:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383666.873338:0:24754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985032576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383666.873377:0:24754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985032576:12345-0@lo:400:kworker.0 Request processed in 40us (11752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383666.873383:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787383666.873396:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787383666.873402:0:24754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985033088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383666.873428:0:24754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985033088:12345-0@lo:400:kworker.0 Request processed in 27us (11760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383666.873441:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787383666.873468:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383666.873472:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787383666.873474:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383666.873477:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383666.873508:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383666.873848:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985032576:0@lo:400:kworker.0 00000100:00100000:1.0:1787383666.873859:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985033088:0@lo:400:kworker.0 00000100:00100000:2.0:1787383666.873926:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985033984 00000100:00100000:2.0:1787383666.873931:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985033984 00000100:00100000:2.0:1787383666.873995:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787383666.874003:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985033984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787383666.874015:0:25506:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787383666.874053:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985033984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383666.874069:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787383666.874137:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985033984:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787383666.874415:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787383667.185493:0:25691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc1dd43d50 00000020:00000080:2.0:1787383667.185510:0:25691:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787383667.185515:0:25691:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787383667.185534:0:25691:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1dd45fe0 20000000:00000080:2.0:1787383667.185542:0:25691:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff96363728fc00 uarg=0000000000000000 20000000:01000000:2.0:1787383667.186082:0:25691:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787383667.186089:0:25691:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787383667.186095:0:25691:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787383667.187049:0:25692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787383667.187217:0:25691:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787383667.200149:0:25691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787383667.200279:0:25691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.200528:0:25691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533004e expref: 23 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.200711:0:25691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533005c expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.200719:0:25691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533009b expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.200726:0:25691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330135 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.200735:0:25691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.200758:0:25691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201097:0:25691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201140:0:25691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201153:0:25691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.201170:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034112:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383667.201314:0:25691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201323:0:25691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 12 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.201341:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034240:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383667.201372:0:25691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec915330135 expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201380:0:25691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec915330135 expref: 23 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.201390:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034368:0@lo:104: 00000100:00100000:3.0:1787383667.201425:0:25691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383667.201471:0:25691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91533009b expref: 23 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201480:0:25691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91533009b expref: 23 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.201489:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034496:0@lo:104: 00000100:00100000:3.0:1787383667.201510:0:25691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383667.201708:0:25691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91533005c expref: 23 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.201718:0:25691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91533005c expref: 23 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.201726:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034624:0@lo:104: 00000100:00100000:3.0:1787383667.201749:0:25691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787383667.204189:0:25691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc40acec91533004e expref: 23 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.204203:0:25691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc40acec91533004e expref: 23 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.204215:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034752:0@lo:104: 00000100:00100000:3.0:1787383667.204255:0:25691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383667.204274:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985034368 00000100:00100000:1.0:1787383667.204281:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985034368 00000100:00100000:1.0:1787383667.204465:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985034496 00000100:00100000:1.0:1787383667.204469:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985034496 00000100:00100000:1.0:1787383667.204484:0:22642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985034624 00000100:00100000:1.0:1787383667.204487:0:22642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985034624 00000100:00100000:1.0:1787383667.204500:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383667.204508:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:25691:x1874206985034368:12345-0@lo:104: 00010000:00010000:1.0:1787383667.204520:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.204816:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383667.204824:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:25691:x1874206985034368:12345-0@lo:104: Request processed in 316us (3397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383667.204832:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787383667.204851:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383667.204857:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:25691:x1874206985034496:12345-0@lo:104: 00010000:00010000:1.0:1787383667.204865:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.205120:0:25691:0:(client.c:2702:ptlrpc_set_wait()) set ffff963635224000 going to sleep for 11 seconds 00000100:00100000:3.0:1787383667.205143:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034368:0@lo:104: 00000100:00100000:3.0:1787383667.205153:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034496:0@lo:104: 00000100:00100000:2.0:1787383667.205217:0:22643:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787383667.205226:0:22643:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787383667.205853:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985034752 00000100:00100000:3.0:1787383667.205859:0:22643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985034752 00000100:00100000:2.0:1787383667.205979:0:25693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787383667.205988:0:25693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:25691:x1874206985034624:12345-0@lo:104: 00010000:00010000:2.0:1787383667.205999:0:25693:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.206098:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034624:0@lo:104: 00010000:00010000:0.0:1787383667.206183:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787383667.206191:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206199:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fda00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383667.206203:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206212:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383667.206219:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383667.206225:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383667.206257:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206263:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383667.206285:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206292:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fda00/0xc40acec915330135 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec91533013c expref: -99 pid: 24981 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206704:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787383667.206709:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206716:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fde00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383667.206719:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206726:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383667.206732:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383667.206737:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383667.206755:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206761:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383667.206782:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206789:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fde00/0xc40acec91533009b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec9153300a2 expref: -99 pid: 24162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206798:0:22648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787383667.206801:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206816:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636013fdc00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:0.0:1787383667.206819:0:22648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206826:0:22648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787383667.206832:0:22648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383667.206837:0:22648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787383667.206851:0:22648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206857:0:22648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787383667.206880:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206886:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636013fdc00/0xc40acec91533005c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330063 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.206894:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383667.206896:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787383667.206897:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383667.206916:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985035008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383667.206950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383667.206978:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383667.206983:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985034880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383667.207010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383667.207027:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383667.207034:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985035136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383667.207051:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383667.207074:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035008 00000100:00100000:0.0:1787383667.207078:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035008 00010000:00010000:0.0:1787383667.207096:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91533009b expref: 24 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383667.207110:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985034880 00000100:00100000:0.0:1787383667.207112:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985034880 00010000:00010000:0.0:1787383667.207120:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec915330135 expref: 25 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383667.207128:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035136 00000100:00100000:0.0:1787383667.207130:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035136 00010000:00010000:0.0:1787383667.207140:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91533005c expref: 26 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383667.207150:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383667.207155:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+26:3650:x1874206985035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383667.207164:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383667.207168:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91533009b expref: 26 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207176:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91533009b expref: 26 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207189:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8600/0xc40acec9153300a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91533009b expref: 26 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207213:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383667.207237:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+25:3650:x1874206985035008:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383667.207243:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787383667.207257:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383667.207262:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3650:x1874206985034880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383667.207268:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383667.207272:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec915330135 expref: 24 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207280:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec915330135 expref: 24 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207290:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c9a00/0xc40acec91533013c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec915330135 expref: 24 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207485:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383667.207512:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:3650:x1874206985034880:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383667.207518:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787383667.207530:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383667.207537:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:3648:x1874206985035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787383667.207665:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383667.207672:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91533005c expref: 22 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207681:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91533005c expref: 22 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207697:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8200/0xc40acec915330063 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91533005c expref: 22 pid: 22653 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383667.207705:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383667.207731:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3648:x1874206985035136:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383667.207737:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787383667.207787:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985035136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383667.207812:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985034880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787383667.207819:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3650:1874206985035008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383667.208038:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787383667.208047:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+5:25691:x1874206985034496:12345-0@lo:104: Request processed in 3189us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383667.208054:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787383667.208073:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383667.208080:0:22642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:25691:x1874206985034752:12345-0@lo:104: 00010000:00010000:1.0:1787383667.208090:0:22642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208141:0:22642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787383667.208146:0:22642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+4:25691:x1874206985034752:12345-0@lo:104: Request processed in 68us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383667.208152:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787383667.208185:0:25118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787383667.208190:0:25118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208197:0:25118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1a00 already unused, calling callback (ffffffffc129ec20) 10000000:00010000:1.0:1787383667.208201:0:25118:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208208:0:25118:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787383667.208215:0:25118:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383667.208221:0:25118:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787383667.208251:0:25118:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208257:0:25118:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787383667.208272:0:25118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208279:0:25118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.102@tcp lock: ffff9636352c1a00/0xc40acec91533004e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc40acec915330055 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208291:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383667.208292:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787383667.208294:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383667.208321:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383667.208341:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985035264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787383667.208369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383667.208400:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035264 00000100:00100000:1.0:1787383667.208404:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035264 00010000:00010000:1.0:1787383667.208419:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91533004e expref: 21 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383667.208438:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383667.208444:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3647:x1874206985035264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787383667.208451:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383667.208455:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc40acec91533004e expref: 21 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208463:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc40acec91533004e expref: 21 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.208473:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383667.208507:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:3647:x1874206985035264:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383667.208513:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787383667.208558:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985035264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787383667.209033:0:25693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787383667.209041:0:25693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+3:25691:x1874206985034624:12345-0@lo:104: Request processed in 3053us (7290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383667.209048:0:25693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787383667.209142:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636113c8400/0xc40acec915330055 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc40acec91533004e expref: 20 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383667.209153:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034752:0@lo:104: 00010000:00010000:1.0:1787383667.209190:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787383667.209277:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383667.214260:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504690a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034112:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383667.218070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383667.218113:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383667.219820:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504692d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25691:1874206985034240:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383667.219868:0:25691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383667.219973:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046464 00000100:00100000:2.0:1787383667.219980:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046464 00000100:00100000:1.0:1787383667.220081:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046592 00000100:00100000:1.0:1787383667.220086:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046592 00010000:00010000:1.0:1787383667.220121:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 14 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383667.220158:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:1.0:1787383667.220166:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edeae43f-301c-483b-b410-d06772b42fd6+14:2401:x1874206966046592:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383667.220181:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383667.220187:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 14 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.220198:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 14 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.220215:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636421f6c00/0xc40acec915330388 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cac expref: 14 pid: 22654 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383667.220239:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383667.220297:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edeae43f-301c-483b-b410-d06772b42fd6+13:2401:x1874206966046592:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 130us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383667.220316:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00010000:00010000:3.0:1787383667.224906:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383667.224991:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:3.0:1787383667.225001:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963604961050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edeae43f-301c-483b-b410-d06772b42fd6+12:2401:x1874206966046464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383667.225014:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383667.225019:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225031:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225047:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff963605828000/0xc40acec9153303c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d1c expref: 12 pid: 22652 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225062:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225071:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225086:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225092:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225110:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225118:0:22646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225123:0:22646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:3.0:1787383667.225128:0:22646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225136:0:22646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225159:0:22646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383667.225168:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383667.225216:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963604961050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edeae43f-301c-483b-b410-d06772b42fd6+11:2401:x1874206966046464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 217us (7156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383667.225223:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00010000:00010000:2.0:1787383667.225415:0:25691:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383667.225424:0:25691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383667.225441:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9636352c0c00/0xc40acec9153303f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383667.356070:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985035392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787383667.356138:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383667.356213:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035392 00000100:00100000:1.0:1787383667.356220:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035392 00000100:00100000:1.0:1787383667.356260:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787383667.356268:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985035392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787383667.356316:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787383667.356360:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985035392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383667.356367:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787383667.356414:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985035392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787383667.358055:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985035520:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787383667.358099:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383667.358949:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035520 00000100:00100000:2.0:1787383667.358958:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035520 00000100:00100000:2.0:1787383667.359011:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787383667.359019:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985035520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787383667.359048:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787383667.373527:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985035520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 14498us (15416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383667.373558:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787383667.374105:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985035520:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787383667.931003:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383668.188055:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787383668.730907:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383668.731008:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046720 00000100:00100000:2.0:1787383668.731019:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046720 00000100:00100000:2.0:1787383668.731075:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:2.0:1787383668.731085:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+11:18074:x1874206966046720:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383668.731101:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383668.731121:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f7c00/0xc40acec9153303ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d54 expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383668.731149:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f7c00/0xc40acec9153303ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d54 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383668.731160:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f7c00/0xc40acec9153303ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d54 expref: 12 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383668.731170:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7c00, rc 0) 00000100:00100000:2.0:1787383668.731243:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+12:18074:x1874206966046720:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 159us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383668.731264:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 146 00000100:00100000:2.0:1787383668.736894:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383668.739217:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046848 00000100:00100000:1.0:1787383668.739230:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046848 00000100:00100000:1.0:1787383668.739308:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:1.0:1787383668.739337:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+12:18074:x1874206966046848:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383668.739755:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+12:18074:x1874206966046848:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 436us (2868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383668.739763:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 147 00000100:00100000:0.0:1787383668.745144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383668.745209:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966046976 00000100:00100000:1.0:1787383668.745219:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966046976 00000100:00100000:1.0:1787383668.745342:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:1.0:1787383668.745352:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+12:18074:x1874206966046976:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383668.745547:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+12:18074:x1874206966046976:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 195us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383668.745556:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 148 00000100:00100000:3.0:1787383668.763925:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383668.764355:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966047104 00000100:00100000:2.0:1787383668.764365:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966047104 00000100:00100000:2.0:1787383668.764419:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:2.0:1787383668.764427:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+12:18074:x1874206966047104:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787383668.764443:0:22654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383668.764868:0:22654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636421f7000/0xc40acec915330406 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d5b expref: -99 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383668.764897:0:22654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636421f7000/0xc40acec915330406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d5b expref: 13 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383668.764908:0:22654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636421f7000/0xc40acec915330406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d5b expref: 13 pid: 22654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383668.764917:0:22654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7000, rc 0) 00000100:00100000:2.0:1787383668.764979:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18074:x1874206966047104:12345-192.168.203.2@tcp:101:ll_cfg_requeue.0 Request processed in 552us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383668.764987:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 149 00000100:00100000:2.0:1787383668.770232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383668.770907:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966047232 00000100:00100000:1.0:1787383668.770917:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966047232 00000100:00100000:1.0:1787383668.771089:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:1.0:1787383668.771100:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+13:18074:x1874206966047232:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787383668.771244:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edeae43f-301c-483b-b410-d06772b42fd6+13:18074:x1874206966047232:12345-192.168.203.2@tcp:501:ll_cfg_requeue.0 Request processed in 145us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383668.771252:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 150 00000100:00100000:0.0:1787383668.786530:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383668.786802:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966047360 00000100:00100000:2.0:1787383668.786811:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966047360 00000100:00100000:2.0:1787383668.786864:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 151 00000100:00100000:2.0:1787383668.786875:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18074:x1874206966047360:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787383668.787020:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:18074:x1874206966047360:12345-192.168.203.2@tcp:503:ll_cfg_requeue.0 Request processed in 147us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383668.787034:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 151 00010000:00010000:1.0:1787383668.955919:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787383669.019307:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383669.019317:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff96363722c800 from 13 10000000:01000000:0.0:1787383669.019324:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383669.019396:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.019444:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.019458:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.019489:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985035648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.019602:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.019654:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383669.019884:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035648 00000100:00100000:1.0:1787383669.019893:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035648 00000100:00100000:1.0:1787383669.020022:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787383669.020032:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+20:22656:x1874206985035648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383669.020057:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.020074:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963605828200/0xc40acec915330414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91533040d expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.020103:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963605828200/0xc40acec915330414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91533040d expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.020117:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963605828200/0xc40acec915330414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533040d expref: 21 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.020128:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828200, rc 0) 00000100:00100000:1.0:1787383669.020540:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635037a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985035648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 507us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.020548:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787383669.020653:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985035648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383669.020671:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330414 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.020681:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330414 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.020756:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985035776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.020817:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.026914:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa900 going to sleep for 11 seconds 00000100:00100000:2.0:1787383669.030526:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035776 00000100:00100000:2.0:1787383669.030549:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035776 00000100:00100000:2.0:1787383669.030706:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787383669.030719:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985035776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787383669.030987:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985035776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (10167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383669.030995:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787383669.031200:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985035776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.031269:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985035904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.031345:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.031381:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.031655:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985035904 00000100:00100000:3.0:1787383669.031660:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985035904 00000100:00100000:3.0:1787383669.031704:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787383669.031722:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985035904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.031873:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985035904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.031881:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787383669.031908:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985035904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787383669.035548:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787383669.036698:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787383669.036733:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787383669.036748:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330414 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.036824:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f17600/0xc40acec91533040d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330414 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787383669.036837:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787383669.036841:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9636356fc800 from 13 10000000:01000000:1.0:1787383669.036844:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787383669.036902:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.036911:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.037253:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383669.037289:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787383669.037447:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383669.037507:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636051440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.037617:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036032 00000100:00100000:3.0:1787383669.037626:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036032 00000100:00100000:3.0:1787383669.037727:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787383669.037738:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+21:22656:x1874206985036032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787383669.037754:0:22653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383669.037814:0:22653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9636352c0000/0xc40acec915330422 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec91533041b expref: -99 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.037844:0:22653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9636352c0000/0xc40acec915330422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec91533041b expref: 22 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.037857:0:22653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9636352c0000/0xc40acec915330422 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec91533041b expref: 22 pid: 22653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.037867:0:22653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0000, rc 0) 00000100:00100000:3.0:1787383669.037936:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985036032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.037944:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787383669.038833:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383669.038859:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330422 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.038871:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330422 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.038995:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.039047:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.044480:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.044662:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036160 00000100:00100000:3.0:1787383669.044675:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036160 00000100:00100000:3.0:1787383669.044751:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787383669.044763:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985036160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.045047:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985036160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (5998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.045075:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787383669.047007:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.047097:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.047305:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.047574:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.047634:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036288 00000100:00100000:3.0:1787383669.047642:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036288 00000100:00100000:3.0:1787383669.047706:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787383669.047716:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985036288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.048047:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985036288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.048057:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787383669.048194:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787383669.049284:0:25706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787383669.051296:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787383669.051348:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787383669.051364:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330422 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.051378:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963605828a00/0xc40acec91533041b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330422 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787383669.051402:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787383669.051406:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff963503110800 from 13 10000000:01000000:0.0:1787383669.051409:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787383669.051463:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.051490:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.051503:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.051537:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.051675:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.051799:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383669.051885:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036416 00000100:00100000:1.0:1787383669.051895:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036416 00000100:00100000:1.0:1787383669.051952:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787383669.051962:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+22:22656:x1874206985036416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383669.051979:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.051995:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963605828400/0xc40acec915330430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330429 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.052024:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963605828400/0xc40acec915330430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330429 expref: 23 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.052050:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963605828400/0xc40acec915330430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330429 expref: 23 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.052060:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828400, rc 0) 00000100:00100000:1.0:1787383669.055715:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985036416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3737us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.055731:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787383669.058412:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383669.058454:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330430 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.058470:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec915330430 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.059399:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.059489:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.059568:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.059690:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036544 00000100:00100000:3.0:1787383669.059700:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036544 00000100:00100000:3.0:1787383669.059793:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787383669.059804:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985036544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.059985:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985036544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.059993:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787383669.060396:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.060445:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.060508:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.060531:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfa900 going to sleep for 11 seconds 00000100:00100000:1.0:1787383669.060609:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036672 00000100:00100000:1.0:1787383669.060615:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036672 00000100:00100000:1.0:1787383669.060662:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787383669.060669:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985036672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787383669.060794:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985036672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.060801:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787383669.061120:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787383669.062378:0:25707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787383669.062679:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787383669.062705:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787383669.062719:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330430 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.062733:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff963610f16200/0xc40acec915330429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec915330430 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787383669.062746:0:22656:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787383669.062749:0:22656:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9635035fe000 from 13 10000000:01000000:3.0:1787383669.062752:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787383669.062833:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.062851:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.062864:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383669.062895:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.062968:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383669.063004:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963602fc6000 going to sleep for 11 seconds 00000100:00100000:1.0:1787383669.063450:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036800 00000100:00100000:1.0:1787383669.063461:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036800 00000100:00100000:1.0:1787383669.063528:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787383669.063539:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+23:22656:x1874206985036800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787383669.063571:0:22652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.063589:0:22652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff963605828c00/0xc40acec91533043e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc40acec915330437 expref: -99 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.063629:0:22652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff963605828c00/0xc40acec91533043e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc40acec915330437 expref: 24 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.063815:0:22652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff963605828c00/0xc40acec91533043e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc40acec915330437 expref: 24 pid: 22652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.063841:0:22652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828c00, rc 0) 00000100:00100000:1.0:1787383669.063913:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985036800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 376us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.063921:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787383669.064154:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787383669.064175:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533043e expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.064187:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc40acec91533043e expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.064281:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.064319:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.064357:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.064483:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985036928 00000100:00100000:3.0:1787383669.064489:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985036928 00000100:00100000:3.0:1787383669.064523:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787383669.064531:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985036928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.064706:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985036928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.064714:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787383669.064966:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985036928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.065006:0:22656:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985037056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787383669.065057:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383669.065077:0:22656:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.065139:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985037056 00000100:00100000:3.0:1787383669.065144:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985037056 00000100:00100000:3.0:1787383669.065178:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787383669.065185:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985037056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787383669.065296:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:22656:x1874206985037056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.065304:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787383669.065448:0:22656:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:22656:1874206985037056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787383669.075900:0:25708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787383669.076073:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787383669.076105:0:22656:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.102@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787383669.076119:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533043e expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.076134:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.102@tcp lock: ffff9636352c1e00/0xc40acec915330437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc40acec91533043e expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383669.165475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383669.165760:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966047488 00000100:00100000:2.0:1787383669.169069:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966047488 00000100:00080000:0.0:1787383669.169416:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787383669.169479:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1787383669.169513:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:18692:x1874206966047488:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383669.169541:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383669.169572:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330445 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d62 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169686:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169703:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169718:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169736:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169743:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169750:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169901:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91533045a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169909:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91533045a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.169917:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91533045a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383669.169972:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383669.169976:0:22660:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383669.170021:0:22660:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91533045a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170035:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170042:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170049:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170056:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383669.170061:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170070:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170085:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:3.0:1787383669.170088:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383669.170093:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170100:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533044c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170118:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170136:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170143:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170148:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383669.170152:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170158:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170167:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff96363d897500) 00010000:00010000:3.0:1787383669.170170:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383669.170173:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170180:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec915330453 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170224:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330445 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d62 expref: 8 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170239:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0200/0xc40acec91533045a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d62 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.170247:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96363d897400) 00010000:00010000:3.0:1787383669.170250:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787383669.170259:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0200, rc 0) 00000100:00100000:3.0:1787383669.170359:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18692:x1874206966047488:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 850us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.170368:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1787383669.184412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.184551:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966047616 00000100:00100000:1.0:1787383669.184566:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966047616 00000100:00100000:1.0:1787383669.184816:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:1.0:1787383669.184829:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18692:x1874206966047616:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787383669.185019:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18692:x1874206966047616:12345-192.168.203.2@tcp:900:lhsmtool_posix.0 Request processed in 192us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.185028:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1787383669.214353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383669.215038:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966047872 00000100:00100000:2.0:1787383669.215053:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966047872 00000100:00100000:2.0:1787383669.215131:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:2.0:1787383669.215143:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18692:x1874206966047872:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787383669.216110:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383669.216148:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330461 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d69 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216470:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216488:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216503:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216520:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216528:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216549:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216708:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec915330476 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216717:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec915330476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.216724:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec915330476 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383669.216736:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787383669.216988:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217006:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217013:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217019:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383669.217024:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217033:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217047:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff96363d897400) 00010000:00010000:2.0:1787383669.217050:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383669.217055:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217061:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330468 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217077:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217082:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217088:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217093:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383669.217102:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217108:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217115:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9636125c0f00) 00010000:00010000:2.0:1787383669.217118:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383669.217121:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.217127:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec91533046f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.219364:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330461 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d69 expref: 10 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.219399:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6c00/0xc40acec915330476 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d69 expref: 9 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.219409:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9636125c0200) 00010000:00010000:2.0:1787383669.219413:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383669.219416:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f6c00, rc 0) 00000100:00100000:2.0:1787383669.219517:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18692:x1874206966047872:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 4374us (5176us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787383669.219527:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:3.0:1787383669.236325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383669.236512:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048000 00000100:00100000:2.0:1787383669.236524:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048000 00000100:00100000:2.0:1787383669.237087:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1787383669.237103:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18692:x1874206966048000:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787383669.237257:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18692:x1874206966048000:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 159us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383669.237267:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:1.0:1787383669.251875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.254791:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048128 00000100:00100000:0.0:1787383669.254812:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048128 00000100:00100000:0.0:1787383669.255008:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:0.0:1787383669.255025:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:18692:x1874206966048128:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1787383669.258961:0:23412:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3875us 00000100:00080000:2.0:1787383669.259808:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383669.303914:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:18692:x1874206966048128:12345-192.168.203.2@tcp:59:lhsmtool_posix.0 Request processed in 48878us (52037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383669.303931:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:0.0:1787383669.333423:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.333551:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048256 00000100:00100000:1.0:1787383669.333565:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048256 00000100:00100000:1.0:1787383669.333806:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1787383669.333820:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18698:x1874206966048256:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383669.333862:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.333893:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec915330484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d70 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.333990:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.334010:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.334053:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.342855:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343680:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343700:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343754:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343762:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343801:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343808:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.343813:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343820:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343833:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:1.0:1787383669.343836:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.343840:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343860:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec91533048b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.343875:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346100:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346108:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346114:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605828e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.346119:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346138:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346154:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9635036bc200) 00010000:00010000:1.0:1787383669.346157:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.346161:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346168:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec915330492 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346227:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec915330484 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d70 expref: 10 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346258:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:1.0:1787383669.346261:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.346265:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec915330484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d70 expref: 10 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.346275:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829600, rc 0) 00000100:00100000:1.0:1787383669.346350:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18698:x1874206966048256:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 12534us (12940us total) trans 0 rc 301/301 00000100:00100000:1.0:1787383669.346361:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:2.0:1787383669.354126:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.354227:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048384 00000100:00100000:0.0:1787383669.354244:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048384 00000100:00100000:0.0:1787383669.354509:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1787383669.354523:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18698:x1874206966048384:12345-192.168.203.2@tcp:700:lfs.0 00000100:00100000:0.0:1787383669.354724:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18698:x1874206966048384:12345-192.168.203.2@tcp:700:lfs.0 Request processed in 203us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383669.354733:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:3.0:1787383669.358884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383669.359006:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048640 00000100:00100000:2.0:1787383669.359021:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048640 00000100:00100000:2.0:1787383669.359104:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1787383669.359116:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:18698:x1874206966048640:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:2.0:1787383669.359196:0:22659:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383669.359229:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec9153303b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402cdd expref: 9 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.359254:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:2.0:1787383669.359261:0:22659:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383669.359520:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.359537:0:22659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 5 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.359546:0:22659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.359600:0:22659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 5 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.359617:0:22659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 5 pid: 23412 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383669.359661:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985037184:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383669.359835:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787383669.362677:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.362756:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048768 00000100:00100000:0.0:1787383669.362811:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048768 00000100:00080000:3.0:1787383669.362880:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787383669.362894:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 6 pid: 23412 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383669.362940:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:0.0:1787383669.362953:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8056f36d-71ba-4e9d-a187-445657578982+6:2402:x1874206966048768:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383669.362971:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383669.362981:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 6 pid: 23412 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.362999:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 6 pid: 23412 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.363027:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:0.0:1787383669.363033:0:22645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.363044:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.363052:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.363110:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383669.363178:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8056f36d-71ba-4e9d-a187-445657578982+6:2402:x1874206966048768:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 228us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383669.363187:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00010000:00010000:2.0:1787383669.365965:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec9153303f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d4d expref: 5 pid: 23412 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383669.365996:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f35180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985037184:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383669.366028:0:22659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.366040:0:22659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.366047:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.366086:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.366102:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383669.366116:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.410908:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.410930:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.410942:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383669.410959:0:22659:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eabeb79d reply state 00000000b49b5c6b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.410970:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.410977:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:1.0:1787383669.410980:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383669.410984:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787383669.410990:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787383669.410998:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411018:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411025:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411032:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.411036:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411044:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411056:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff96350244a000) 00010000:00010000:1.0:1787383669.411059:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.411063:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411070:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec915330499 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787383669.411091:0:22659:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eabeb79d reply state 00000000b49b5c6b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411100:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.411106:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9636125c0f00) 00010000:00010000:1.0:1787383669.411109:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787383669.411111:0:22659:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787383669.411205:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+10:18698:x1874206966048640:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 52088us (52328us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787383669.411220:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:3.0:1787383669.490096:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.490250:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966048896 00000100:00100000:0.0:1787383669.490263:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966048896 00000100:00100000:1.0:1787383669.490413:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:1.0:1787383669.490427:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+10:18706:x1874206966048896:12345-192.168.203.2@tcp:101:lctl.0 00010000:00010000:1.0:1787383669.490459:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.490492:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d77 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.490606:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec9153304b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.490623:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec9153304b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.490636:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec9153304b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383669.490716:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787383669.490721:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383669.490816:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec9153304b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.490848:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d77 expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.490869:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829800/0xc40acec9153304b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d77 expref: 11 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.490879:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:1.0:1787383669.490902:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383669.490907:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829800, rc 0) 00000100:00100000:1.0:1787383669.490995:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+11:18706:x1874206966048896:12345-192.168.203.2@tcp:101:lctl.0 Request processed in 571us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.491003:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 29 00000100:00100000:3.0:1787383669.508244:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.512047:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966049024 00000100:00100000:0.0:1787383669.512079:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966049024 00000100:00100000:0.0:1787383669.512183:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:0.0:1787383669.512196:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8056f36d-71ba-4e9d-a187-445657578982+5:18707:x1874206966049024:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383669.512225:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383669.512264:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d7e expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.512353:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec9153304c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.512370:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec9153304c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.512384:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec9153304c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383669.512440:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787383669.512443:0:23412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787383669.512467:0:23412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec9153304c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.512496:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d7e expref: 7 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.512538:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17c00/0xc40acec9153304c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d7e expref: 6 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.512548:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:0.0:1787383669.512551:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383669.512556:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17c00, rc 0) 00000100:00100000:0.0:1787383669.512657:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8056f36d-71ba-4e9d-a187-445657578982+6:18707:x1874206966049024:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 464us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383669.512666:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 30 00000100:00100000:3.0:1787383669.520103:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.520246:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966049152 00000100:00100000:1.0:1787383669.520256:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966049152 00000100:00100000:1.0:1787383669.520324:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:1.0:1787383669.520336:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+6:18707:x1874206966049152:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383669.520374:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.520401:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d85 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520484:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520500:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520513:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520526:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520697:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520705:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520872:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec9153304df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520881:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec9153304df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.520889:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec9153304df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383669.522086:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787383669.522099:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383669.522137:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec9153304df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522156:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522163:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522171:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522178:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.522183:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522192:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522212:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:1.0:1787383669.522236:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.522242:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522249:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec9153304d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522269:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522275:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522281:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522286:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.522289:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522296:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522305:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9636125c0f00) 00010000:00010000:1.0:1787383669.522308:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.522311:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522317:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153304d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522357:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d85 expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522383:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec9153304df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d85 expref: 7 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.522391:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:1.0:1787383669.522394:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383669.522396:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829000, rc 0) 00000100:00100000:1.0:1787383669.522506:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+7:18707:x1874206966049152:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 2171us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.522517:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 31 00000100:00100000:3.0:1787383669.528501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.528882:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966049280 00000100:00100000:1.0:1787383669.528895:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966049280 00000100:00100000:1.0:1787383669.528978:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:1.0:1787383669.528990:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8056f36d-71ba-4e9d-a187-445657578982+5:18707:x1874206966049280:12345-192.168.203.2@tcp:900:lfs.0 00000100:00100000:1.0:1787383669.529161:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8056f36d-71ba-4e9d-a187-445657578982+5:18707:x1874206966049280:12345-192.168.203.2@tcp:900:lfs.0 Request processed in 173us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.529170:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00080000:3.0:1787383669.530389:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383669.542688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.542872:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966049536 00000100:00100000:0.0:1787383669.542886:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966049536 00000100:00100000:0.0:1787383669.542971:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:0.0:1787383669.543010:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8056f36d-71ba-4e9d-a187-445657578982+7:18707:x1874206966049536:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383669.543037:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383669.543063:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d8c expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383669.543413:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787383669.543565:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d8c expref: 9 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.544834:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:0.0:1787383669.544841:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383669.544851:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d8c expref: 9 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.544897:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16800, rc 0) 00000100:00100000:1.0:1787383669.553902:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8056f36d-71ba-4e9d-a187-445657578982+8:18707:x1874206966049536:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 10894us (11209us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787383669.553919:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 32 00000100:00100000:2.0:1787383669.568071:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.569055:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966049792 00000100:00100000:0.0:1787383669.569214:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966049792 00000100:00100000:0.0:1787383669.569372:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:0.0:1787383669.569388:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8056f36d-71ba-4e9d-a187-445657578982+8:18707:x1874206966049792:12345-192.168.203.2@tcp:36:lfs.0 00010000:00010000:0.0:1787383669.569466:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383669.569672:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec9153304df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d85 expref: 8 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.570023:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:0.0:1787383669.570033:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383669.570081:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.570097:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.570109:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383669.570382:0:22660:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca78ab3b reply state 000000003c86dac3 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.570396:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383669.570403:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:0.0:1787383669.570406:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787383669.570426:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787383669.570437:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787383669.570577:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8056f36d-71ba-4e9d-a187-445657578982+9:18707:x1874206966049792:12345-192.168.203.2@tcp:36:lfs.0 Request processed in 1192us (2519us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787383669.570587:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 33 00000100:00100000:3.0:1787383669.574431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.574658:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966050048 00000100:00100000:0.0:1787383669.574672:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966050048 00000100:00100000:0.0:1787383669.574760:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:0.0:1787383669.574815:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8056f36d-71ba-4e9d-a187-445657578982+9:18707:x1874206966050048:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383669.575103:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8056f36d-71ba-4e9d-a187-445657578982+10:18707:x1874206966050048:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 292us (687us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787383669.575112:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1787383669.579478:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.589609:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966050304 00000100:00100000:1.0:1787383669.589633:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966050304 00000100:00100000:1.0:1787383669.589754:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:1.0:1787383669.589785:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8056f36d-71ba-4e9d-a187-445657578982+10:18707:x1874206966050304:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383669.589821:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.589868:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d93 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.589957:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.589973:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.589987:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.589997:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590005:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590011:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383669.590155:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787383669.590244:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590252:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590259:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590266:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.590271:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590296:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590312:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:1.0:1787383669.590315:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.590320:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590326:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590342:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590349:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590355:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590360:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383669.590363:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590370:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590376:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9636125c0f00) 00010000:00010000:1.0:1787383669.590378:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383669.590394:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590411:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829c00/0xc40acec915330509 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590451:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d93 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590462:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:1.0:1787383669.590464:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383669.590468:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605828e00/0xc40acec9153304fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d93 expref: 12 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.590479:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828e00, rc 0) 00000100:00100000:1.0:1787383669.590565:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8056f36d-71ba-4e9d-a187-445657578982+11:18707:x1874206966050304:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 801us (11102us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1787383669.590574:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 34 00000100:00100000:3.0:1787383669.598199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.598817:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966050432 00000100:00100000:1.0:1787383669.598830:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966050432 00000100:00100000:1.0:1787383669.598907:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:1.0:1787383669.598919:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+11:18707:x1874206966050432:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383669.598951:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.598978:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec915330517 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402d9a expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.599086:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.599099:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.601634:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383669.601721:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787383669.601727:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787383669.602073:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.602140:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829000/0xc40acec915330517 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 13 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.602164:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.602175:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:1.0:1787383669.602178:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787383669.602182:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829200, rc 0) 00000100:00100000:1.0:1787383669.603236:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+12:18707:x1874206966050432:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 4308us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.603251:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 35 00000100:00100000:0.0:1787383669.614999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.615184:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966050560 00000100:00100000:1.0:1787383669.615198:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966050560 00000100:00100000:1.0:1787383669.615308:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:1.0:1787383669.615321:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8056f36d-71ba-4e9d-a187-445657578982+12:18707:x1874206966050560:12345-192.168.203.2@tcp:37:lfs.0 00000100:00100000:2.0:1787383669.631898:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8056f36d-71ba-4e9d-a187-445657578982+12:18707:x1874206966050560:12345-192.168.203.2@tcp:37:lfs.0 Request processed in 16564us (16897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383669.631926:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 3 00000100:00100000:3.0:1787383669.637913:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.637976:0:22663:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787383669.637990:0:22663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1787383669.638259:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966050816 00000100:00100000:3.0:1787383669.638272:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966050816 00000100:00100000:3.0:1787383669.639715:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:3.0:1787383669.639830:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361047a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8056f36d-71ba-4e9d-a187-445657578982+12:18707:x1874206966050816:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383669.640250:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361047a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8056f36d-71ba-4e9d-a187-445657578982+13:18707:x1874206966050816:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 519us (2350us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1787383669.640260:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 4 00000100:00100000:0.0:1787383669.762206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383669.762412:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966050944 00000100:00100000:3.0:1787383669.762426:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966050944 00000100:00100000:3.0:1787383669.762512:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:3.0:1787383669.762524:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+11:18713:x1874206966050944:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383669.762563:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383669.762603:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330525 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402da1 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762688:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762715:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762731:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762745:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762753:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762759:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762924:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1800/0xc40acec91533053a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762934:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1800/0xc40acec91533053a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.762968:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1800/0xc40acec91533053a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383669.763015:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787383669.763020:0:23412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383669.763066:0:23412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1800/0xc40acec91533053a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763081:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763088:0:23412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763095:0:23412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763101:0:23412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383669.763107:0:23412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763115:0:23412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763146:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:3.0:1787383669.763149:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383669.763154:0:23412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763160:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533052c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763189:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763196:0:23412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763202:0:23412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763207:0:23412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383669.763210:0:23412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763216:0:23412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763224:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9636125c0f00) 00010000:00010000:3.0:1787383669.763226:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383669.763229:0:23412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763235:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330533 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.763269:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330525 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da1 expref: 13 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.764036:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1800/0xc40acec91533053a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da1 expref: 12 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.764066:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:3.0:1787383669.764068:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787383669.764072:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1800, rc 0) 00000100:00100000:3.0:1787383669.764239:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+12:18713:x1874206966050944:12345-192.168.203.2@tcp:101:bash.0 Request processed in 1715us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.764249:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 36 00000100:00100000:1.0:1787383669.775249:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383669.780952:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966051072 00000100:00100000:2.0:1787383669.780974:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966051072 00000100:00100000:2.0:1787383669.781443:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:2.0:1787383669.781460:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:18713:x1874206966051072:12345-192.168.203.2@tcp:900:bash.0 00000100:00100000:2.0:1787383669.781602:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:18713:x1874206966051072:12345-192.168.203.2@tcp:900:bash.0 Request processed in 147us (6366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383669.781610:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1787383669.787874:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383669.788377:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966051328 00000100:00100000:3.0:1787383669.788390:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966051328 00000100:00100000:3.0:1787383669.788458:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:3.0:1787383669.788470:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+12:18713:x1874206966051328:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383669.788497:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383669.788536:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330541 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402da8 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.788699:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.788718:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.788727:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.788819:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 12 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.788838:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 12 pid: 22661 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383669.788886:0:22660:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1874206985037312:192.168.203.2@tcp:104: 00000100:00100000:3.0:1787383669.789001:0:22660:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350375ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383669.793979:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.794152:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966051456 00000100:00100000:1.0:1787383669.794174:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966051456 00010000:00010000:1.0:1787383669.794256:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 13 pid: 22661 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383669.794324:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:1.0:1787383669.794336:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8056f36d-71ba-4e9d-a187-445657578982+13:2401:x1874206966051456:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787383669.794357:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787383669.794365:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 13 pid: 22661 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.794382:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 13 pid: 22661 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.794412:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:1.0:1787383669.794418:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.794430:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.794439:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.794464:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787383669.794529:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8056f36d-71ba-4e9d-a187-445657578982+13:2401:x1874206966051456:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 194us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383669.794538:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00010000:00010000:3.0:1787383669.797077:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829200/0xc40acec91533051e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402d9a expref: 12 pid: 22661 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383669.797110:0:22660:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d133b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22660:1874206985037312:192.168.203.2@tcp:104: 00010000:00010000:3.0:1787383669.797476:0:22660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.797488:0:22660:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.797495:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.802569:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.802606:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.802620:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803084:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803094:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803114:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383669.803126:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787383669.803151:0:22660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803158:0:22660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803163:0:22660:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803182:0:22660:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c0c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383669.803186:0:22660:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803193:0:22660:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803206:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:3.0:1787383669.803209:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383669.803214:0:22660:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803219:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec915330548 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787383669.803233:0:22660:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026f08349 reply state 0000000087fe1113 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803253:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803268:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff96363d897500) 00010000:00010000:3.0:1787383669.803270:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383669.803273:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787383669.803310:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330541 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 15 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803325:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 14 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.803332:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383669.803335:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787383669.803337:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c1600, rc 0) 00000100:00100000:3.0:1787383669.803413:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+15:18713:x1874206966051328:12345-192.168.203.2@tcp:101:bash.0 Request processed in 14944us (15552us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787383669.803421:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 37 00000100:00100000:0.0:1787383669.825918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.826036:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966051584 00000100:00100000:1.0:1787383669.826055:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966051584 00000100:00100000:3.0:1787383669.826220:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:3.0:1787383669.826237:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+15:18713:x1874206966051584:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383669.826271:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383669.826310:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330564 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402daf expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826401:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826444:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826458:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383669.826522:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787383669.826540:0:23412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383669.826565:0:23412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826578:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826622:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1400/0xc40acec915330564 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402daf expref: 17 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826645:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402daf expref: 16 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383669.826655:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383669.826658:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383669.826663:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636352c0c00, rc 0) 00000100:00100000:3.0:1787383669.826763:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+16:18713:x1874206966051584:12345-192.168.203.2@tcp:101:bash.0 Request processed in 531us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383669.826971:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 38 00000100:00100000:1.0:1787383669.840345:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383669.840476:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966051840 00000100:00100000:3.0:1787383669.840489:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966051840 00000100:00100000:3.0:1787383669.840576:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:3.0:1787383669.840611:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+16:18713:x1874206966051840:12345-192.168.203.2@tcp:35:bash.0 00000100:00100000:0.0:1787383669.841146:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+17:18713:x1874206966051840:12345-192.168.203.2@tcp:35:bash.0 Request processed in 528us (805us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1787383669.841161:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 5 00000100:00100000:0.0:1787383669.968657:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383669.968814:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966052096 00000100:00100000:1.0:1787383669.968824:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966052096 00000100:00100000:1.0:1787383669.968881:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:1.0:1787383669.968891:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+17:18723:x1874206966052096:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:1.0:1787383669.968914:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383669.968934:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402db6 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383669.969034:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787383669.969131:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330572 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402db6 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.969145:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:1.0:1787383669.969148:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787383669.969153:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec915330572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402db6 expref: 19 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383669.969167:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829a00, rc 0) 00000100:00100000:1.0:1787383669.969220:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+18:18723:x1874206966052096:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 330us (572us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1787383669.969227:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 39 00000100:00100000:3.0:1787383669.975732:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383669.975873:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966052352 00000100:00100000:0.0:1787383669.975882:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966052352 00000100:00100000:0.0:1787383669.975943:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 6 00000100:00100000:0.0:1787383669.975954:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+18:18723:x1874206966052352:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383669.976166:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+19:18723:x1874206966052352:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 214us (442us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1787383669.976188:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 6 00010000:00010000:3.0:1787383669.980117:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383670.040378:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383670.040465:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966052608 00000100:00100000:3.0:1787383670.040475:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966052608 00000100:00100000:3.0:1787383670.040545:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:3.0:1787383670.040555:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+19:18726:x1874206966052608:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383670.040580:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383670.040610:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec915330580 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dbd expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.040726:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec915330587 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.040740:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec915330587 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.041173:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec915330587 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383670.041186:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787383670.041292:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec915330580 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dbd expref: 22 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.041310:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec915330587 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dbd expref: 21 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.041319:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383670.041322:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383670.041338:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8200, rc 0) 00000100:00100000:3.0:1787383670.041401:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:18726:x1874206966052608:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 847us (1031us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1787383670.041409:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 40 00000100:00100000:1.0:1787383670.046794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383670.046888:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.047091:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966052864 00000100:00100000:0.0:1787383670.047100:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966052864 00000100:00100000:0.0:1787383670.047165:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:0.0:1787383670.047175:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:2401:x1874206966052864:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383670.047191:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383670.047215:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8200/0xc40acec915330587 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dbd expref: 21 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.047233:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383670.047237:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383670.047299:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:2401:x1874206966052864:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 125us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.047307:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383670.048176:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966052736 00000100:00100000:2.0:1787383670.048183:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966052736 00000100:00100000:2.0:1787383670.048265:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:2.0:1787383670.048273:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:18726:x1874206966052736:12345-192.168.203.2@tcp:54:lfs.0 00010000:00010000:2.0:1787383670.048337:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048353:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048363:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048402:0:22661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048409:0:22661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048415:0:22661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048421:0:22661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383670.048437:0:22661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.048445:0:22661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.049050:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383670.049054:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787383670.049058:0:22661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383670.049064:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec915330595 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383670.049131:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:18726:x1874206966052736:12345-192.168.203.2@tcp:54:lfs.0 Request processed in 857us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383670.049139:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 41 00000100:00100000:1.0:1787383670.058561:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.059000:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053120 00000100:00100000:0.0:1787383670.059010:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053120 00000100:00100000:0.0:1787383670.059070:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 7 00000100:00100000:0.0:1787383670.059081:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:18726:x1874206966053120:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:0.0:1787383670.059303:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:18726:x1874206966053120:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 223us (751us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787383670.059311:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 7 00000040:00080000:0.0:1787383670.171552:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1787383670.235803:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787383670.332950:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333002:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333140:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333159:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333179:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.333237:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053632 00000100:00100000:0.0:1787383670.333246:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053632 00000100:00100000:0.0:1787383670.333310:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966054144 00000100:00100000:0.0:1787383670.333313:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966054144 00000100:00100000:0.0:1787383670.333328:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053760 00000100:00100000:0.0:1787383670.333330:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053760 00000100:00100000:0.0:1787383670.333341:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966054272 00000100:00100000:0.0:1787383670.333344:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966054272 00000100:00100000:0.0:1787383670.333359:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1787383670.333369:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966053632:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383670.333437:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966053632:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.333445:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 16 00000100:00100000:0.0:1787383670.333471:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1787383670.333478:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8056f36d-71ba-4e9d-a187-445657578982+5:2401:x1874206966054144:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383670.333502:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8056f36d-71ba-4e9d-a187-445657578982+5:2401:x1874206966054144:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.333509:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:0.0:1787383670.333520:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383670.333526:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966053760:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383670.333559:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966053760:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.333565:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383670.333578:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383670.333594:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8056f36d-71ba-4e9d-a187-445657578982+5:2401:x1874206966054272:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383670.333616:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8056f36d-71ba-4e9d-a187-445657578982+5:2401:x1874206966054272:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.333622:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:1.0:1787383670.334218:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053376 00000100:00100000:1.0:1787383670.334224:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053376 00000100:00100000:1.0:1787383670.334254:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053888 00000100:00100000:1.0:1787383670.334257:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053888 00000100:00100000:2.0:1787383670.334288:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053504 00000100:00100000:1.0:1787383670.334299:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966054016 00000100:00100000:1.0:1787383670.334304:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966054016 00000100:00100000:2.0:1787383670.334315:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053504 00000100:00100000:1.0:1787383670.334324:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:1.0:1787383670.334346:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:2401:x1874206966053376:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383670.334387:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:2.0:1787383670.334400:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+12:2401:x1874206966053888:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383670.334411:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:2401:x1874206966053376:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 73us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383670.334419:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:1.0:1787383670.334442:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1787383670.334451:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8056f36d-71ba-4e9d-a187-445657578982+5:2401:x1874206966054016:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:2.0:1787383670.334490:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8056f36d-71ba-4e9d-a187-445657578982+12:2401:x1874206966053888:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 88us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383670.334501:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8056f36d-71ba-4e9d-a187-445657578982+5:2401:x1874206966054016:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 43us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383670.334512:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1787383670.334625:0:22654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966053248 00000100:00100000:3.0:1787383670.334632:0:22654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966053248 00000100:00100000:3.0:1787383670.334688:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:3.0:1787383670.334696:0:22654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:2401:x1874206966053248:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:3.0:1787383670.334747:0:22654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edeae43f-301c-483b-b410-d06772b42fd6+13:2401:x1874206966053248:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 51us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383670.334754:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 164 00000100:00100000:1.0:1787383670.335107:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:1.0:1787383670.335142:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1787383670.335152:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966053504:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:1.0:1787383670.335206:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966053504:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 57us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383670.335213:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00080000:2.0:1787383670.345210:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787383670.345245:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383670.539842:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383670.539973:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966054528 00000100:00100000:1.0:1787383670.539987:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966054528 00000100:00100000:1.0:1787383670.540069:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:1.0:1787383670.540082:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:18757:x1874206966054528:12345-192.168.203.2@tcp:101:cat.0 00010000:00010000:1.0:1787383670.540110:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383670.540143:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829e00/0xc40acec91533059c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dc4 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.540351:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153305a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.540371:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153305a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.540387:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153305a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787383670.540404:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787383670.542903:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829e00/0xc40acec91533059c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dc4 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.542944:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153305a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dc4 expref: 23 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.542955:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:1.0:1787383670.542958:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787383670.542962:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829400, rc 0) 00000100:00100000:1.0:1787383670.543067:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+23:18757:x1874206966054528:12345-192.168.203.2@tcp:101:cat.0 Request processed in 2985us (3238us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1787383670.543077:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 42 00000100:00100000:0.0:1787383670.550015:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383670.550117:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966054784 00000100:00100000:3.0:1787383670.550130:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966054784 00000100:00100000:3.0:1787383670.550212:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1787383670.550224:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+23:18757:x1874206966054784:12345-192.168.203.2@tcp:35:cat.0 00000100:00100000:3.0:1787383670.550623:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+24:18757:x1874206966054784:12345-192.168.203.2@tcp:35:cat.0 Request processed in 400us (623us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787383670.550632:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 8 00000100:00100000:3.0:1787383670.551644:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383670.551719:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966054912 00000100:00100000:0.0:1787383670.551728:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966054912 00000100:00100000:0.0:1787383670.551816:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:0.0:1787383670.551826:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+24:2402:x1874206966054912:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383670.551844:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383670.551876:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153305a3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dc4 expref: 24 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.551900:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383670.551905:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383670.551960:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+23:2402:x1874206966054912:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 136us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.551968:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 1 00000100:00100000:1.0:1787383670.689908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383670.690313:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966055168 00000100:00100000:3.0:1787383670.690328:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966055168 00000100:00100000:0.0:1787383670.690548:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:0.0:1787383670.690566:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+23:18763:x1874206966055168:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:0.0:1787383670.690628:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383670.690659:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec9153305b1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dcb expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.690966:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153305b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.690999:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153305b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.691013:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153305b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383670.691029:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383670.691571:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16a00/0xc40acec9153305b1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dcb expref: 26 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.691608:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153305b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dcb expref: 25 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383670.691619:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383670.691622:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383670.691627:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17800, rc 0) 00000100:00100000:0.0:1787383670.691926:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+25:18763:x1874206966055168:12345-192.168.203.2@tcp:101:dd.0 Request processed in 1362us (2031us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1787383670.691936:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 43 00000100:00100000:3.0:1787383670.711760:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383670.713760:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966055296 00000100:00100000:1.0:1787383670.713798:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966055296 00000100:00100000:1.0:1787383670.713873:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:1.0:1787383670.713883:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+25:18763:x1874206966055296:12345-192.168.203.2@tcp:101:dd.0 00010000:00010000:1.0:1787383670.713932:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383670.713969:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829e00/0xc40acec9153305c6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dd2 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.714006:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.714019:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.714031:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.714146:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829e00/0xc40acec9153305c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 27 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.714165:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 26 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383670.714174:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:1.0:1787383670.714177:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787383670.714180:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605829a00, rc 0) 00000100:00100000:1.0:1787383670.714260:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+26:18763:x1874206966055296:12345-192.168.203.2@tcp:101:dd.0 Request processed in 378us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383670.714269:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 44 00000100:00100000:2.0:1787383670.719858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383670.720045:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966055552 00000100:00100000:3.0:1787383670.720055:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966055552 00000100:00100000:3.0:1787383670.720102:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 45 00000100:00100000:3.0:1787383670.720112:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+26:18763:x1874206966055552:12345-192.168.203.2@tcp:36:dd.0 00010000:00010000:3.0:1787383670.720191:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787383670.720221:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153305b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dcb expref: 26 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.720251:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c0c00/0xc40acec91533056b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402daf expref: 25 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.720269:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383670.720274:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383670.720441:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.720455:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.720465:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383670.720507:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787383670.720526:0:22660:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c874174a reply state 00000000ad281eb2 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.720550:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383670.720557:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383670.720560:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383670.720562:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383670.720659:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+27:18763:x1874206966055552:12345-192.168.203.2@tcp:36:dd.0 Request processed in 548us (810us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787383670.720676:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 45 00000020:00080000:3.0:1787383670.720682:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787383670.883135:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383670.883221:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966055808 00000100:00100000:3.0:1787383670.883231:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966055808 00000100:00100000:3.0:1787383670.883296:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383670.883307:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+27:18763:x1874206966055808:12345-192.168.203.2@tcp:35:dd.0 00000100:00100000:3.0:1787383670.883681:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+28:18763:x1874206966055808:12345-192.168.203.2@tcp:35:dd.0 Request processed in 374us (554us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787383670.883690:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 9 00000100:00100000:3.0:1787383670.945913:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985037440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787383670.945984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383670.946086:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985037440 00000100:00100000:0.0:1787383670.946093:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985037440 00000100:00100000:0.0:1787383670.946185:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383670.946194:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985037440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787383670.946220:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787383670.946263:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985037440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383670.946271:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787383670.946312:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96350447dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985037440:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787383670.946442:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787383671.003051:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787383671.104070:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.104256:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966055936 00000100:00100000:3.0:1787383671.104266:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966055936 00000100:00100000:3.0:1787383671.104438:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00100000:3.0:1787383671.104448:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+28:18777:x1874206966055936:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:3.0:1787383671.104470:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383671.104489:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305db lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dd9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104547:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104570:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104590:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104617:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104625:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104632:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104700:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104709:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104716:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383671.104757:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787383671.104761:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383671.104821:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104833:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104841:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104847:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104861:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104867:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383671.104870:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104878:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104889:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:3.0:1787383671.104891:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383671.104895:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104901:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153305e2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104913:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104919:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104925:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104931:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383671.104934:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104951:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104959:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff96363d897500) 00010000:00010000:3.0:1787383671.104962:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383671.104965:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104971:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153305e9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.104996:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305db lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd9 expref: 30 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.105008:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd9 expref: 29 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.105016:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.105018:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383671.105020:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8800, rc 0) 00000100:00100000:3.0:1787383671.105081:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350447dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+29:18777:x1874206966055936:12345-192.168.203.2@tcp:101:stat.0 Request processed in 634us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.105088:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 46 00000100:00080000:2.0:1787383671.107045:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787383671.209530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.210041:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966056192 00000100:00100000:3.0:1787383671.210051:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966056192 00000100:00100000:3.0:1787383671.210167:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 47 00000100:00100000:3.0:1787383671.210177:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+29:18783:x1874206966056192:12345-192.168.203.2@tcp:36:truncate.0 00010000:00010000:3.0:1787383671.210244:0:22660:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383671.210271:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305f0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd9 expref: 29 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.210290:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.210294:0:22660:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787383671.210452:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.210466:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.210476:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787383671.210542:0:22660:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1787383671.210572:0:22660:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006984165a reply state 000000006130e919 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.211865:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.211873:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.211876:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787383671.211880:0:22660:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787383671.212029:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+31:18783:x1874206966056192:12345-192.168.203.2@tcp:36:truncate.0 Request processed in 1851us (2505us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787383671.212038:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 47 00000020:00080000:3.0:1787383671.212044:0:22660:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787383671.416994:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.421010:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966056320 00000100:00100000:3.0:1787383671.421042:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966056320 00000100:00100000:3.0:1787383671.421116:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:3.0:1787383671.421127:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+31:18798:x1874206966056320:12345-192.168.203.2@tcp:101:stat.0 00010000:00010000:3.0:1787383671.421149:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383671.421171:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305fe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402de0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421236:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421251:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421262:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421271:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421278:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421284:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421350:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421358:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421366:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383671.421408:0:22659:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1787383671.421413:0:22659:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383671.421430:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421441:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421449:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421455:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421471:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421477:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9e00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383671.421482:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421489:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421500:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:3.0:1787383671.421702:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383671.421707:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421714:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec915330605 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421736:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421742:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421748:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421753:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383671.421756:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421762:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421831:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff96363d897500) 00010000:00010000:3.0:1787383671.421833:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383671.421837:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421843:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533060c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421869:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec9153305fe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 33 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421881:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 32 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.421899:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.421901:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787383671.421904:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8a00, rc 0) 00000100:00100000:3.0:1787383671.421981:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+32:18798:x1874206966056320:12345-192.168.203.2@tcp:101:stat.0 Request processed in 855us (4995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.421990:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 48 00000100:00100000:1.0:1787383671.604697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383671.604807:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966056576 00000100:00100000:0.0:1787383671.604816:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966056576 00000100:00100000:0.0:1787383671.604872:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383671.604881:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+32:18808:x1874206966056576:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:0.0:1787383671.604913:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383671.604932:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91533061a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402de7 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383671.605114:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787383671.605223:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91533061a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de7 expref: 34 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.605238:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:0.0:1787383671.605241:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383671.605246:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec91533061a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de7 expref: 34 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.605260:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:0.0:1787383671.605320:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+33:18808:x1874206966056576:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 440us (630us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1787383671.605341:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 49 00000100:00100000:0.0:1787383671.617415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383671.617663:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966056832 00000100:00100000:2.0:1787383671.617687:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966056832 00000100:00100000:2.0:1787383671.617746:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:2.0:1787383671.617758:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96361047a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+33:18808:x1874206966056832:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:2.0:1787383671.618041:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96361047a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+34:18808:x1874206966056832:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 285us (635us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1787383671.618050:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 10 00000100:00100000:1.0:1787383671.779640:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383671.781667:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057088 00000100:00100000:2.0:1787383671.781683:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057088 00000100:00100000:2.0:1787383671.782617:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:2.0:1787383671.782632:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+34:18814:x1874206966057088:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383671.782657:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383671.782679:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec915330628 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dee expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.782878:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.783331:0:23412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.783345:0:23412:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 35 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.783354:0:23412:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.783392:0:23412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 35 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.783427:0:23412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 35 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383671.783442:0:23412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23412:1874206985037568:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383671.784876:0:23412:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.786366:0:23412:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383671.786399:0:23412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23412:1874206985037696:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383671.786505:0:23412:0:(client.c:2702:ptlrpc_set_wait()) set ffff963634734b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787383671.793746:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.794266:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057216 00000100:00100000:3.0:1787383671.794285:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057216 00010000:00010000:3.0:1787383671.794327:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 36 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383671.794358:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 17 00000100:00100000:3.0:1787383671.794369:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+36:2401:x1874206966057216:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383671.794402:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383671.794411:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 36 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.794424:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 36 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.794446:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.794451:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.794460:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.794489:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383671.794691:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+36:2401:x1874206966057216:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 323us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.794699:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 17 00010000:00010000:2.0:1787383671.794828:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8a00/0xc40acec915330613 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402de0 expref: 35 pid: 22659 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383671.794847:0:23412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23412:1874206985037568:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383671.805998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383671.806147:0:23412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23412:1874206985037696:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383671.806177:0:23412:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383671.806399:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057344 00000100:00100000:0.0:1787383671.806406:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057344 00010000:00010000:0.0:1787383671.806442:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383671.806488:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 18 00000100:00100000:0.0:1787383671.806498:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963604962450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+35:2401:x1874206966057344:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383671.806521:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383671.806529:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.806542:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.806563:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1600/0xc40acec915330556 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402da8 expref: 35 pid: 22660 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.806587:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383671.806592:0:22645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.806602:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.806610:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.806652:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383671.806706:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963604962450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+34:2401:x1874206966057344:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 208us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383671.806713:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 18 00010000:00010000:2.0:1787383671.807280:0:23412:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.807289:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383671.807318:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787383671.807447:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec915330628 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 35 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.807467:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 34 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.807475:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383671.807478:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787383671.807481:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636421f7a00, rc 0) 00000100:00100000:2.0:1787383671.807528:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+34:18814:x1874206966057088:12345-192.168.203.2@tcp:101:bash.0 Request processed in 24900us (27896us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1787383671.807536:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 50 00000100:00100000:1.0:1787383671.810086:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383671.810162:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057600 00000100:00100000:2.0:1787383671.810171:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057600 00000100:00100000:2.0:1787383671.810229:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 51 00000100:00100000:2.0:1787383671.810240:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+34:18814:x1874206966057600:12345-192.168.203.2@tcp:36:bash.0 00010000:00010000:2.0:1787383671.810439:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.810456:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.810468:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383671.810505:0:22661:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1787383671.810548:0:22661:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e7e361b7 reply state 00000000a7ec16e6 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.810562:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.810570:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383671.810581:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787383671.810584:0:22661:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383671.810662:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18814:x1874206966057600:12345-192.168.203.2@tcp:36:bash.0 Request processed in 423us (585us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1787383671.810670:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 51 00000020:00080000:2.0:1787383671.810675:0:22661:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787383671.822852:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.823673:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057728 00000100:00100000:3.0:1787383671.823685:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057728 00000100:00100000:3.0:1787383671.823756:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:3.0:1787383671.823790:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18814:x1874206966057728:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383671.823813:0:22659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383671.823834:0:22659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330644 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402df5 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.823891:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330644 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402df5 expref: 38 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.823918:0:22659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330644 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402df5 expref: 38 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.823937:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.823941:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383671.823944:0:22659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8800, rc 0) 00000100:00100000:3.0:1787383671.824004:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18814:x1874206966057728:12345-192.168.203.2@tcp:101:bash.0 Request processed in 240us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.824011:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 52 00000100:00100000:1.0:1787383671.831112:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383671.831254:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057856 00000100:00100000:2.0:1787383671.831263:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057856 00000100:00100000:2.0:1787383671.831320:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:2.0:1787383671.831330:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18814:x1874206966057856:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383671.831351:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383671.831371:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec91533064b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402dfc expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.831460:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.831487:0:22661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 39 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.831497:0:22661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.831530:0:22661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 39 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.831556:0:22661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 39 pid: 23412 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383671.831571:0:22661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22661:1874206985037824:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383671.831658:0:22661:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347343c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787383671.834788:0:22661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22661:1874206985037824:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383671.834820:0:22661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383671.836107:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383671.836840:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966057984 00000100:00100000:0.0:1787383671.836849:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966057984 00010000:00010000:0.0:1787383671.836890:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 40 pid: 23412 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383671.836947:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 19 00000100:00100000:0.0:1787383671.836958:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+40:2401:x1874206966057984:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383671.836972:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383671.836979:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 40 pid: 23412 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.836992:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 40 pid: 23412 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.837014:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7a00/0xc40acec91533062f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dee expref: 40 pid: 23412 timeout: 804 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.837031:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383671.837036:0:22644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.837046:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.837070:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383671.837100:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383671.837153:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+39:2401:x1874206966057984:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 197us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383671.837161:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 19 00010000:00010000:2.0:1787383671.837644:0:22661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.837654:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383671.837708:0:22661:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787383671.837713:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383671.837747:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.837817:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7600/0xc40acec91533064b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dfc expref: 39 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.837834:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dfc expref: 38 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383671.837842:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383671.837854:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787383671.837857:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a6a00, rc 0) 00000100:00100000:2.0:1787383671.837887:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18814:x1874206966057856:12345-192.168.203.2@tcp:101:bash.0 Request processed in 6558us (6783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383671.837907:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 53 00000100:00100000:0.0:1787383671.850762:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.851211:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966058240 00000100:00100000:3.0:1787383671.851221:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966058240 00000100:00100000:3.0:1787383671.851301:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1787383671.851311:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18814:x1874206966058240:12345-192.168.203.2@tcp:103:bash.0 00010000:00010000:3.0:1787383671.851327:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787383671.851352:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330644 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402df5 expref: 38 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.851374:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6a00/0xc40acec915330652 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dfc expref: 37 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.851386:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.851391:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383671.851448:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+36:18814:x1874206966058240:12345-192.168.203.2@tcp:103:bash.0 Request processed in 138us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.851455:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 2 00000100:00100000:3.0:1787383671.854885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383671.855081:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966058368 00000100:00100000:1.0:1787383671.855092:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966058368 00000100:00100000:1.0:1787383671.855152:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1787383671.855162:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+36:18814:x1874206966058368:12345-192.168.203.2@tcp:58:bash.0 00010000:00010000:1.0:1787383671.855265:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383671.855282:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383671.855295:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787383671.856443:0:22659:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787383671.856583:0:22659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1787383671.856690:0:22659:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1787383671.856849:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+36:18814:x1874206966058368:12345-192.168.203.2@tcp:58:bash.0 Request processed in 1685us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383671.856859:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 54 00000100:00100000:1.0:1787383671.864347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383671.864427:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966058496 00000100:00100000:3.0:1787383671.864436:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966058496 00000100:00100000:3.0:1787383671.864498:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1787383671.864508:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+36:18814:x1874206966058496:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:3.0:1787383671.864535:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383671.864554:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e03 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.864614:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.864626:0:22660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 37 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.864658:0:22660:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.864671:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 37 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.864684:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383671.864687:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383671.864691:0:22660:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 37 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383671.864700:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8800, rc 0) 00000100:00100000:3.0:1787383671.864761:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18814:x1874206966058496:12345-192.168.203.2@tcp:101:bash.0 Request processed in 254us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.864799:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 55 00000100:00100000:3.0:1787383671.963036:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787383671.963058:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985037952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383671.963127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383671.963405:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383671.963416:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985038080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787383671.963449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383671.963673:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985037952 00000100:00100000:3.0:1787383671.963681:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985037952 00000100:00100000:3.0:1787383671.963750:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038080 00000100:00100000:3.0:1787383671.963754:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038080 00000100:00100000:3.0:1787383671.963799:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787383671.963808:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985037952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383671.963834:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383671.963886:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985037952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.963917:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787383671.963936:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383671.963942:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985038080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383671.963952:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383671.963980:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985038080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.963985:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787383671.964026:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985037952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787383671.964158:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985038080:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787383671.964176:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787383671.965097:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635045bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985038208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383671.965135:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.965213:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038208 00000100:00100000:1.0:1787383671.965219:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038208 00000100:00100000:1.0:1787383671.965272:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787383671.965281:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985038208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383671.965303:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383671.965338:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985038208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383671.965344:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383671.965484:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635045bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985038208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787383671.965503:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383671.966076:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985038464:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.966109:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.966134:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206985038976:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.966159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.966174:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206985039488:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.966194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.966212:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787383671.966218:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985038336:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.966242:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.966328:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985038848:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.966355:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.966371:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206985039360:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.966391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383671.966416:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038336 00000100:00100000:1.0:1787383671.966420:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038336 00000100:00100000:1.0:1787383671.966448:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787383671.966454:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3648:x1874206985038336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.966613:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985038592:0@lo:400:kworker.0 00000100:00100000:3.0:1787383671.966670:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038464 00000100:00100000:3.0:1787383671.966674:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038464 00000100:00100000:3.0:1787383671.966705:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787383671.966712:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985038464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383671.966784:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985038720:0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.972073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383671.972130:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985039104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.972172:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383671.972223:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038976 00000100:00100000:2.0:1787383671.972231:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038976 00000100:00100000:3.0:1787383671.972619:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985038464:12345-0@lo:400:kworker.0 Request processed in 5904us (6506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.972630:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787383671.972688:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985038464:0@lo:400:kworker.0 00000100:00100000:3.0:1787383671.972715:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985039488 00000100:00100000:3.0:1787383671.972718:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985039488 00000100:00100000:2.0:1787383671.972798:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985039360 00000100:00100000:2.0:1787383671.972803:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985039360 00000100:00080000:0.0:1787383671.972969:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383671.972975:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383671.972989:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038848 00000100:00100000:0.0:1787383671.972993:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038848 00000100:00100000:0.0:1787383671.973023:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383671.973032:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985038848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383671.973090:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985038848:12345-0@lo:400:kworker.0 Request processed in 59us (6734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383671.973109:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787383671.973140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383671.973168:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206985039232:0@lo:400:kworker.0 00000100:00100000:0.0:1787383671.973193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383671.973229:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038592 00000100:00100000:0.0:1787383671.973233:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038592 00000100:00100000:1.0:1787383671.976437:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3648:x1874206985038336:12345-0@lo:400:kworker.0 Request processed in 9973us (10184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383671.976452:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787383671.976683:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3648:1874206985038336:0@lo:400:kworker.0 00000100:00100000:3.0:1787383671.976700:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985038848:0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.976847:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985038720 00000100:00100000:2.0:1787383671.976855:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985038720 00000100:00100000:0.0:1787383671.976992:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985039104 00000100:00100000:0.0:1787383671.976996:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985039104 00000100:00080000:0.0:1787383671.977019:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787383671.977038:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985039232 00000100:00100000:0.0:1787383671.977041:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985039232 00000100:00080000:0.0:1787383671.977054:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787383671.977069:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383671.977077:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206985038976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.978867:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383671.978889:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985038720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.979022:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985038720:12345-0@lo:400:kworker.0 Request processed in 142us (5880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383671.979032:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787383671.979084:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985038720:0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.979115:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383671.979124:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206985039488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.979169:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1874206985039488:12345-0@lo:400:kworker.0 Request processed in 47us (12973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383671.979177:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383671.979208:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787383671.979215:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206985039360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.979244:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1874206985039360:12345-0@lo:400:kworker.0 Request processed in 30us (12852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383671.979250:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787383671.979535:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1874206985038976:12345-0@lo:400:kworker.0 Request processed in 2456us (13372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383671.979556:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787383671.979566:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985038592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.979611:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985038592:12345-0@lo:400:kworker.0 Request processed in 48us (7547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383671.979706:0:22660:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787383671.979742:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1874206985039360:0@lo:400:kworker.0 00000100:00100000:3.0:1787383671.979756:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1874206985038976:0@lo:400:kworker.0 00010000:00080000:3.0:1787383671.979794:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636409a6a00 x1874206985039488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383671.979805:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1874206985039488:0@lo:400:kworker.0 00000100:00100000:3.0:1787383671.979832:0:22660:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787383671.981643:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787383671.981679:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985039104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383671.981840:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383671.981870:0:22659:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787383671.981881:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383671.981890:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206985039232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383671.981960:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874206985039232:12345-0@lo:400:kworker.0 Request processed in 71us (8765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383671.981967:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787383671.982032:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985038592:0@lo:400:kworker.0 00000100:00100000:1.0:1787383671.982163:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985039104:12345-0@lo:400:kworker.0 Request processed in 492us (9989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383671.982170:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787383671.982293:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985039104:0@lo:400:kworker.0 00000100:00100000:2.0:1787383671.982391:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787383671.982426:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9636409a7480 x1874206985039232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787383671.982438:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1874206985039232:0@lo:400:kworker.0 00010000:00010000:1.0:1787383672.028597:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787383672.282975:0:22695:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787383672.282985:0:22695:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383672.283012:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787383672.283021:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1787383672.283160:0:22695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22695:1874206985039616:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787383672.283247:0:22695:0:(client.c:2702:ptlrpc_set_wait()) set ffff96350375e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787383672.285526:0:22695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22695:1874206985039616:192.168.203.2@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787383672.287997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.288332:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966058624 00000100:00100000:1.0:1787383672.288341:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966058624 00000100:00100000:1.0:1787383672.288412:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:1.0:1787383672.288431:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18815:x1874206966058624:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787383672.288461:0:22659:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787383672.288843:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18815:x1874206966058624:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 421us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.288851:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 56 00000100:00100000:1.0:1787383672.307318:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.307442:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966058752 00000100:00100000:2.0:1787383672.307452:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966058752 00000100:00100000:2.0:1787383672.307529:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:2.0:1787383672.307539:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18815:x1874206966058752:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787383672.307618:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307635:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307648:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307697:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307718:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307726:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307752:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307761:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307794:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787383672.307840:0:23412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787383672.307845:0:23412:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787383672.307857:0:23412:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307868:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307875:0:23412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307882:0:23412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307888:0:23412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.307892:0:23412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307906:0:23412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307918:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9636125c0200) 00010000:00010000:2.0:1787383672.307921:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.307926:0:23412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307932:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330667 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307945:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307950:0:23412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307956:0:23412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307961:0:23412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.307963:0:23412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307969:0:23412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307975:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9636125c0500) 00010000:00010000:2.0:1787383672.307978:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.307981:0:23412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.307996:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec91533066e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.308011:0:23412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.308016:0:23412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.308021:0:23412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.308026:0:23412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.308029:0:23412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.308034:0:23412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.309123:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383672.309129:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.309134:0:23412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.309142:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7200/0xc40acec915330675 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383672.309290:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18815:x1874206966058752:12345-192.168.203.2@tcp:34:lhsmtool_posix.0 Request processed in 1749us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383672.309300:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 57 00000100:00100000:3.0:1787383672.318812:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.319091:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966059008 00000100:00100000:0.0:1787383672.319100:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966059008 00000100:00100000:0.0:1787383672.319211:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:0.0:1787383672.319221:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+37:18815:x1874206966059008:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383672.319241:0:25711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383672.319260:0:25711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91533067c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e0a expref: -99 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319372:0:25711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319388:0:25711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319400:0:25711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787383672.319411:0:25711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787383672.319497:0:25711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319504:0:25711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319520:0:25711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319526:0:25711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:0.0:1787383672.319531:0:25711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319538:0:25711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319564:0:25711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383672.319567:0:25711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787383672.319580:0:25711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319586:0:25711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330683 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319629:0:25711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91533067c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e0a expref: 39 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319639:0:25711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9636125c0200) 00010000:00010000:0.0:1787383672.319642:0:25711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787383672.319645:0:25711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec91533067c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e0a expref: 39 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.319654:0:25711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16000, rc 0) 00000100:00100000:0.0:1787383672.319717:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18815:x1874206966059008:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 498us (914us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787383672.319725:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 58 00000100:00100000:0.0:1787383672.326903:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.327049:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966059136 00000100:00100000:2.0:1787383672.327059:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966059136 00000100:00100000:2.0:1787383672.327117:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:2.0:1787383672.327126:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18815:x1874206966059136:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787383672.327161:0:22661:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787383672.327276:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18815:x1874206966059136:12345-192.168.203.2@tcp:53:lhsmtool_posix.0 Request processed in 150us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383672.327285:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 59 00000100:00100000:2.0:1787383672.333084:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.336348:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966059392 00000100:00100000:0.0:1787383672.336365:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966059392 00000100:00100000:0.0:1787383672.337323:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:0.0:1787383672.337340:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+38:18815:x1874206966059392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383672.337361:0:23412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383672.337726:0:23412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec915330691 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e11 expref: -99 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787383672.339054:0:23412:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1787383672.339063:0:23412:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1787383672.339084:0:23412:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1787383672.339247:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330698 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.339262:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330698 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.339283:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330698 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.339343:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16000/0xc40acec915330691 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e11 expref: 41 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.339362:0:23412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330698 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e11 expref: 40 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.339371:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff963502446100) 00010000:00010000:0.0:1787383672.339374:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787383672.339388:0:23412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f17000, rc 0) 00000100:00100000:0.0:1787383672.339481:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+40:18815:x1874206966059392:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2135us (6394us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1787383672.339491:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 60 00000100:00100000:1.0:1787383672.353257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.357151:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966059648 00000100:00100000:0.0:1787383672.357167:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966059648 00000100:00100000:2.0:1787383672.365082:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:2.0:1787383672.365096:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+40:18815:x1874206966059648:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383672.365163:0:25711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787383672.365198:0:25711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17000/0xc40acec915330698 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e11 expref: 40 pid: 23412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365219:0:25711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff963502446100) 00010000:00010000:2.0:1787383672.365228:0:25711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787383672.365250:0:25711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365272:0:25711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365282:0:25711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365296:0:25711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365320:0:25711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365328:0:25711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365385:0:25711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365393:0:25711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365400:0:25711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365406:0:25711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7c00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.365410:0:25711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365426:0:25711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365435:0:25711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:2.0:1787383672.365438:0:25711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.365442:0:25711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365447:0:25711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7c00/0xc40acec9153306a6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365457:0:25711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365480:0:25711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365487:0:25711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365491:0:25711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.365495:0:25711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365501:0:25711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365809:0:25711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x6435e425 (ffff9636125c0500) 00010000:00010000:2.0:1787383672.365813:0:25711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.365818:0:25711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.365825:0:25711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306ad lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x6435e425 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383672.365968:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+39:18815:x1874206966059648:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 872us (12716us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787383672.365975:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:1.0:1787383672.378579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.378709:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966059776 00000100:00100000:3.0:1787383672.378720:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966059776 00000100:00100000:3.0:1787383672.378799:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:3.0:1787383672.378809:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+39:18815:x1874206966059776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383672.378829:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383672.378852:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306b4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e18 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.378891:0:22660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153306bb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.378903:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153306bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.378915:0:22660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153306bb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.379034:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306b4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e18 expref: 41 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.379053:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9e00/0xc40acec9153306bb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e18 expref: 40 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.379061:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383672.379064:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787383672.379067:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9e00, rc 0) 00000100:00100000:3.0:1787383672.379126:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+40:18815:x1874206966059776:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 318us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383672.379133:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:0.0:1787383672.388537:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.388834:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966060032 00000100:00100000:2.0:1787383672.388844:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966060032 00000100:00100000:2.0:1787383672.388905:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:2.0:1787383672.388915:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+40:18815:x1874206966060032:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787383672.388998:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.389025:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.389036:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787383672.389402:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1787383672.389414:0:23412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 705417647857ns, next at 706417645214ns, rc = 0 00000004:00010000:2.0:1787383672.389463:0:23412:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009f481ef3 reply state 00000000ff8f7594 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.390323:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.390332:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:2.0:1787383672.390335:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787383672.390339:0:23412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787383672.390448:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+42:18815:x1874206966060032:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 1532us (1917us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1787383672.390457:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:1.0:1787383672.401520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.401809:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966060160 00000100:00100000:3.0:1787383672.401821:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966060160 00000100:00100000:3.0:1787383672.401893:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:3.0:1787383672.401904:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+42:18815:x1874206966060160:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383672.401929:0:25711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383672.401949:0:25711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e1f expref: -99 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.402007:0:25711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 43 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.402022:0:25711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 43 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.402078:0:25711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383672.402082:0:25711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787383672.402086:0:25711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c8600, rc 0) 00000100:00100000:3.0:1787383672.402144:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+43:18815:x1874206966060160:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 241us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383672.402151:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:0.0:1787383672.421599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.421735:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966060288 00000100:00100000:2.0:1787383672.421745:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966060288 00000100:00100000:2.0:1787383672.421842:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1787383672.421853:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2401:x1874206966060288:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787383672.422092:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96350441a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2401:x1874206966060288:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 241us (502us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1787383672.422101:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00080000:0.0:1787383672.422174:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383672.452005:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.452181:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966060544 00000100:00100000:3.0:1787383672.452191:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966060544 00000100:00100000:3.0:1787383672.452246:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383672.452256:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+43:18815:x1874206966060544:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787383672.452846:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+44:18815:x1874206966060544:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 589us (849us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1787383672.452858:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 11 00000100:00100000:3.0:1787383672.471087:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.471525:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966060800 00000100:00100000:1.0:1787383672.471534:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966060800 00000100:00100000:1.0:1787383672.471947:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:1.0:1787383672.471959:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+44:18815:x1874206966060800:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787383672.472076:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+44:18815:x1874206966060800:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 118us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.472083:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 65 00000100:00100000:0.0:1787383672.476157:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383672.476180:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985039744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383672.476243:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383672.476305:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985039744 00000100:00100000:0.0:1787383672.476313:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985039744 00000100:00100000:0.0:1787383672.476368:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383672.476377:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985039744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787383672.476409:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1787383672.476453:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1874206985039744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.476461:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787383672.476506:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503ff5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1874206985039744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383672.479347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.485582:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985039872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383672.485644:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383672.485693:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985039872 00000100:00100000:0.0:1787383672.485699:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985039872 00000100:00100000:0.0:1787383672.485742:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383672.485751:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985039872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787383672.485798:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787383672.485842:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874206985039872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.485849:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787383672.485894:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362da08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985039872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787383672.485967:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966060928 00000100:00100000:2.0:1787383672.485984:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966060928 00000100:00100000:3.0:1787383672.486074:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:3.0:1787383672.486084:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+44:18815:x1874206966060928:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787383672.486095:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383672.486113:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9c00/0xc40acec9153306d0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e26 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.486185:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec9153306d7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.486199:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec9153306d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.486218:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec9153306d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383672.486258:0:22661:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787383672.486275:0:22661:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec9153306d7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.486301:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9c00/0xc40acec9153306d0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e26 expref: 46 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.486316:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec9153306d7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e26 expref: 45 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.487042:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383672.487045:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787383672.487048:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9200, rc 0) 00000100:00100000:3.0:1787383672.487103:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+45:18815:x1874206966060928:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 1020us (7762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383672.487110:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 66 00000100:00100000:0.0:1787383672.492357:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.492606:0:24754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966061056 00000100:00100000:1.0:1787383672.492622:0:24754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966061056 00000100:00100000:1.0:1787383672.492679:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:1.0:1787383672.492689:0:24754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+6:2402:x1874206966061056:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787383672.492706:0:24754:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383672.492726:0:24754:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e2d expref: -99 pid: 24754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383672.492752:0:24754:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894f78, blocks: 0x0 00010000:00010000:1.0:1787383672.492802:0:24754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1787383672.492807:0:24754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383672.492816:0:24754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 7 pid: 24754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.492834:0:24754:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 7 pid: 24754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.492847:0:24754:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828e00, rc 0) 00000100:00100000:1.0:1787383672.492900:0:24754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96362da08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:2402:x1874206966061056:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 213us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.492908:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:1.0:1787383672.498199:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.498273:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966061312 00000100:00100000:0.0:1787383672.498284:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966061312 00000100:00100000:0.0:1787383672.498353:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:0.0:1787383672.498364:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+45:18815:x1874206966061312:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787383672.498479:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+45:18815:x1874206966061312:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 117us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.498487:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 67 00000100:00100000:3.0:1787383672.502645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.502755:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966061440 00000100:00100000:1.0:1787383672.502800:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966061440 00000100:00100000:1.0:1787383672.502857:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:1.0:1787383672.502867:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+45:18815:x1874206966061440:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787383672.505084:0:22639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:2.0:1787383672.505099:0:22639:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787383672.505177:0:22639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1787383672.509699:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.509729:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.509737:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.509744:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f16800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383672.509749:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.509756:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.509816:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:1.0:1787383672.509819:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787383672.509825:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.509831:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f16800/0xc40acec9153304f4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383672.509980:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:18815:x1874206966061440:12345-192.168.203.2@tcp:44:lhsmtool_posix.0 Request processed in 7110us (7339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.509989:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 68 00000100:00100000:0.0:1787383672.510172:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383672.510188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985040000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787383672.510237:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787383672.510277:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985040000 00000100:00100000:0.0:1787383672.510283:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985040000 00000100:00100000:0.0:1787383672.510319:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787383672.510327:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985040000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787383672.510438:0:24169:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787383672.510441:0:24169:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787383672.510444:0:24169:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787383672.510446:0:24169:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787383672 -> 1787383672 00002000:00010000:0.0:1787383672.510449:0:24169:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787383672.510479:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1874206985040000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (242us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787383672.510486:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1787383672.510521:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9635044a7100/2, rc 0, transno 12884901892 00000100:00100000:0.0:1787383672.510528:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985040000:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787383672.519907:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.519926:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.519935:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.519960:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f7200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.519965:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.519972:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.519988:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9636125c0f00) 00010000:00010000:3.0:1787383672.519991:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383672.519994:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520000:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f7200/0xc40acec9153304a0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520020:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520027:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520033:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520038:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.520041:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520046:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520064:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:3.0:1787383672.520066:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383672.520070:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520076:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829600/0xc40acec9153304a7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520090:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520096:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520102:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520107:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636352c1a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.520110:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520116:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520124:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff96363d897500) 00010000:00010000:3.0:1787383672.520127:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383672.520129:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520135:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636352c1a00/0xc40acec91533054f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520162:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520181:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520188:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520193:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.520196:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520201:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520209:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383672.520211:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383672.520214:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520219:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8400/0xc40acec9153305d4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520229:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520235:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520241:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520255:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c9a00 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.520257:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520263:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520272:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383672.520274:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383672.520276:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520282:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec9153305f7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22660 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520293:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520299:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520305:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520310:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636421f6400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.520313:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520319:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520337:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:3.0:1787383672.520339:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787383672.520342:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520348:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636421f6400/0xc40acec91533063d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520361:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520367:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520372:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520377:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:3.0:1787383672.520380:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520385:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520392:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383672.520395:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787383672.520397:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.520403:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec9153306c2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383672.522246:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.522380:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966061568 00000100:00100000:1.0:1787383672.522389:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966061568 00000100:00100000:1.0:1787383672.522441:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:1.0:1787383672.522450:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636059c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:2402:x1874206966061568:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787383672.522684:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636059c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:2402:x1874206966061568:12345-192.168.203.2@tcp:16:lhsmtool_posix.0 Request processed in 234us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.522704:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:2.0:1787383672.526676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.526908:0:23412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966061824 00000100:00100000:0.0:1787383672.526919:0:23412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966061824 00000100:00100000:0.0:1787383672.526979:0:23412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:0.0:1787383672.527001:0:23412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+14:18815:x1874206966061824:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787383672.527051:0:23412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383672.527077:0:23412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9200/0xc40acec9153306d7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e26 expref: 14 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.527095:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:0.0:1787383672.527099:0:23412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787383672.527129:0:23412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.527141:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.527150:0:23412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787383672.527266:0:23412:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cfc11f9b reply state 0000000057dbc923 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.527278:0:23412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.527283:0:23412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:0.0:1787383672.527286:0:23412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787383672.527288:0:23412:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787383672.527377:0:23412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+15:18815:x1874206966061824:12345-192.168.203.2@tcp:36:lhsmtool_posix.0 Request processed in 377us (709us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1787383672.527384:0:23412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 69 00000100:00100000:3.0:1787383672.534079:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.534171:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966061952 00000100:00100000:0.0:1787383672.534179:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966061952 00000100:00100000:0.0:1787383672.534253:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383672.534263:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18815:x1874206966061952:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787383672.534280:0:24167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787383672.534306:0:24167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e34 expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.534344:0:24167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.534353:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383672.534356:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383672.534361:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.534394:0:24167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.534407:0:24167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383672.534420:0:24167:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24167:1874206985040128:192.168.203.2@tcp:104: 00000100:00100000:0.0:1787383672.534506:0:24167:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383672.536800:0:24167:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24167:1874206985040128:192.168.203.2@tcp:104: 00010000:00010000:0.0:1787383672.536832:0:24167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.536869:0:24167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963610f16a00, rc 0) 00000100:00100000:0.0:1787383672.536919:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:18815:x1874206966061952:12345-192.168.203.2@tcp:101:lhsmtool_posix.0 Request processed in 2657us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.536927:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:1.0:1787383672.540174:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.540269:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062080 00000100:00100000:0.0:1787383672.540277:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062080 00010000:00010000:0.0:1787383672.540455:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383672.540494:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:0.0:1787383672.540504:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2401:x1874206966062080:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383672.540527:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383672.540548:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.540562:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.540595:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec9153306de lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e2d expref: 8 pid: 24754 timeout: 805 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.540611:0:22645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383672.540615:0:22645:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787383672.540622:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 7 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.540646:0:22645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 7 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.540680:0:22645:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 7 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383672.540696:0:22645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22645:1874206985040256:192.168.203.2@tcp:105: 00000100:00100000:0.0:1787383672.541090:0:22645:0:(client.c:2702:ptlrpc_set_wait()) set ffff963627bfac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787383672.546462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.546593:0:22645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22645:1874206985040256:192.168.203.2@tcp:105: 00010000:00010000:0.0:1787383672.546617:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383672.546666:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635045bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:2401:x1874206966062080:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 6164us (6500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.546676:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 20 00000100:00100000:2.0:1787383672.547055:0:25116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062208 00000100:00100000:2.0:1787383672.547063:0:25116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062208 00000100:00100000:2.0:1787383672.547106:0:25116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:2.0:1787383672.547114:0:25116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:2401:x1874206966062208:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787383672.547252:0:25116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787383672.547256:0:25116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787383671 00002000:00010000:2.0:1787383672.547258:0:25116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787383669 00002000:00010000:2.0:1787383672.547261:0:25116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787383672 -> 1787383671 00002000:00010000:2.0:1787383672.547263:0:25116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787383672.547296:0:25116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2401:x1874206966062208:12345-192.168.203.2@tcp:2:lhsmtool_posix.0 Request processed in 183us (842us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787383672.547302:0:25116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 25 00000100:00100000:3.0:1787383672.555631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.555739:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062336 00000100:00100000:1.0:1787383672.555748:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062336 00000100:00100000:1.0:1787383672.555837:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:1.0:1787383672.555847:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2402:x1874206966062336:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787383672.555895:0:24168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.555914:0:24168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.555923:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383672.555927:0:24168:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787383672.555931:0:24168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.555965:0:24168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.555977:0:24168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 8 pid: 24167 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383672.555991:0:24168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24168:1874206985040384:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383672.556071:0:24168:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383672.568524:0:24168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24168:1874206985040384:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383672.568555:0:24168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383672.569888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.569986:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062464 00000100:00100000:0.0:1787383672.569995:0:22644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062464 00010000:00010000:0.0:1787383672.570035:0:22644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 9 pid: 24167 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383672.570074:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383672.570083:0:22644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+9:2402:x1874206966062464:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383672.570097:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383672.570117:0:22644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 9 pid: 24167 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.570143:0:22644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 9 pid: 24167 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.570176:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065c267cf/0xc40acec9153306ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e34 expref: 9 pid: 24167 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.570193:0:22644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383672.570197:0:22644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787383672.570204:0:22644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.570214:0:22644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.570247:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383672.570319:0:22644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2402:x1874206966062464:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 236us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.570327:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00010000:00010000:1.0:1787383672.571228:0:24168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571243:0:24168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571274:0:24168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571282:0:24168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571298:0:24168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571305:0:24168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829e00 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:1.0:1787383672.571310:0:24168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571319:0:24168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571349:0:24168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.571355:0:24168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c940361/0xc40acec9153306f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383672.571419:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:2402:x1874206966062336:12345-192.168.203.2@tcp:1:lhsmtool_posix.0 Request processed in 15573us (15796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.571428:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 26 00000100:00100000:3.0:1787383672.578029:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383672.578106:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062720 00000100:00100000:1.0:1787383672.578116:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062720 00000100:00100000:1.0:1787383672.578178:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 70 00000100:00100000:1.0:1787383672.578188:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+15:18815:x1874206966062720:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787383672.578283:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.578309:0:22659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 15 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.578319:0:22659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.578363:0:22659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 15 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.578377:0:22659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 15 pid: 22659 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787383672.578403:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985040512:192.168.203.2@tcp:104: 00000100:00100000:1.0:1787383672.578481:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff963620ee16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383672.581680:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963636928a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985040512:192.168.203.2@tcp:104: 00010000:00010000:1.0:1787383672.581708:0:22659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383672.583113:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383672.583631:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062848 00000100:00100000:0.0:1787383672.583641:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062848 00010000:00010000:0.0:1787383672.583679:0:22645:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 16 pid: 22659 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787383672.583724:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1787383672.583741:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+16:2401:x1874206966062848:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787383672.583808:0:22645:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787383672.583816:0:22645:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 16 pid: 22659 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583828:0:22645:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 16 pid: 22659 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583848:0:22645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829a00/0xc40acec9153305cd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402dd2 expref: 16 pid: 22659 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583864:0:22645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:0.0:1787383672.583870:0:22645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 15 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583880:0:22645:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583886:0:22645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583892:0:22645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787383672.583915:0:22645:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787383672.583970:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+15:2401:x1874206966062848:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 230us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383672.583977:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00010000:00010000:2.0:1787383672.584100:0:22659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.584109:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.584332:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.584345:0:22659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 15 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.584366:0:22659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.584395:0:22659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 15 pid: 25711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.584408:0:22659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 15 pid: 25711 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383672.584421:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985040640:192.168.203.2@tcp:104: 00000100:00100000:2.0:1787383672.584471:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff963634734f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787383672.604153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.607428:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985040640:192.168.203.2@tcp:104: 00010000:00010000:2.0:1787383672.607459:0:22659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383672.608897:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966062976 00000100:00100000:3.0:1787383672.608908:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966062976 00010000:00010000:3.0:1787383672.608950:0:22646:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 16 pid: 25711 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787383672.609040:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:3.0:1787383672.609051:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+16:2402:x1874206966062976:12345-192.168.203.2@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787383672.609065:0:22646:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787383672.609072:0:22646:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 16 pid: 25711 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.609085:0:22646:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 16 pid: 25711 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.609106:0:22646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec9153306c9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e1f expref: 16 pid: 25711 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.609121:0:22646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:3.0:1787383672.609125:0:22646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.609151:0:22646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.609159:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.609192:0:22646:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787383672.609259:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+15:2402:x1874206966062976:12345-192.168.203.2@tcp:103:ldlm_bl.0 Request processed in 208us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383672.609274:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00010000:00010000:2.0:1787383672.613007:0:22659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.613024:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787383672.613140:0:22659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:2.0:1787383672.613251:0:22659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:2.0:1787383672.613299:0:22659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:2.0:1787383672.613382:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22659:1874206985040768:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787383672.613460:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383672.613489:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636082f6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787383672.614188:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985040768 00000100:00100000:1.0:1787383672.614197:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985040768 00000100:00100000:1.0:1787383672.614247:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787383672.614256:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22659:x1874206985040768:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787383672.614354:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22659:x1874206985040768:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.614361:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787383672.614796:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22659:1874206985040768:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787383672.614942:0:22659:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:2.0:1787383672.614989:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22659:1874206985040896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787383672.615019:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383672.615043:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347343c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787383672.615902:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985040896 00000100:00100000:1.0:1787383672.615909:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985040896 00000100:00100000:1.0:1787383672.615954:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787383672.615962:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22659:x1874206985040896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787383672.616091:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22659:x1874206985040896:12345-0@lo:1000:mdt00_000.0 Request processed in 129us (1071us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1787383672.616098:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787383672.616172:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503f34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22659:1874206985040896:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787383672.616207:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616218:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616226:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616232:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6200 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.616237:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616245:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616271:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:2.0:1787383672.616275:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383672.616279:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616286:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330701 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616314:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616342:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616348:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616354:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605828000 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.616357:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616364:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616373:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383672.616376:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787383672.616383:0:22659:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616393:0:22659:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616403:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.616453:0:22659:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8800/0xc40acec915330660 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e03 expref: 18 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383672.616464:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636084b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985041024:192.168.203.2@tcp:105: 00000100:00100000:2.0:1787383672.616546:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9636347343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787383672.621435:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.621559:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966063104 00000100:00100000:3.0:1787383672.621577:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966063104 00000100:00100000:3.0:1787383672.621634:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:3.0:1787383672.621643:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+19:18814:x1874206966063104:12345-192.168.203.2@tcp:49:bash.0 00000100:00100000:3.0:1787383672.622117:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+19:18814:x1874206966063104:12345-192.168.203.2@tcp:49:bash.0 Request processed in 474us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383672.622125:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 12 00000100:00100000:2.0:1787383672.631830:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636084b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22659:1874206985041024:192.168.203.2@tcp:105: 00010000:00010000:2.0:1787383672.631861:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631872:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605828000/0xc40acec915330659 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631908:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631921:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631932:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631942:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631948:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631955:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631961:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.631964:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631971:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.631999:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383672.632002:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.632005:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632011:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330708 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632020:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632026:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632032:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632037:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963605829400 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.632040:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632046:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632052:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383672.632054:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383672.632056:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.632061:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963605829400/0xc40acec9153306fa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787383672.632414:0:22695:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787383672.632419:0:22695:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787383672.632432:0:22695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1787383672.632438:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787383672.632597:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+18:18815:x1874206966062720:12345-192.168.203.2@tcp:57:lhsmtool_posix.0 Request processed in 54408us (54574us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1787383672.632607:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 70 00000020:00080000:2.0:1787383672.632612:0:22659:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787383672.637231:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.640041:0:24167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966063232 00000100:00100000:2.0:1787383672.640054:0:24167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966063232 00000100:00100000:0.0:1787383672.643154:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.643234:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966063488 00000100:00100000:3.0:1787383672.643242:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966063488 00000100:00100000:3.0:1787383672.643301:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 13 00000100:00100000:3.0:1787383672.643311:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+18:18815:x1874206966063488:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787383672.643583:0:25710:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787383672.643613:0:25710:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:3.0:1787383672.643655:0:25710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.643671:0:25710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.643682:0:25710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.643690:0:25710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.643697:0:25710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.643713:0:25710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.644058:0:25710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787383672.644129:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:18815:x1874206966063488:12345-192.168.203.2@tcp:35:lhsmtool_posix.0 Request processed in 819us (983us total) trans 12884901926 rc 0/0 00000100:00100000:3.0:1787383672.644137:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 13 00000020:00080000:3.0:1787383672.644142:0:25710:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787383672.647234:0:24167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 27 00000100:00100000:1.0:1787383672.647248:0:24167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963636928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+7:18814:x1874206966063232:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:1.0:1787383672.647272:0:24167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787383672.647307:0:24167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec915330716 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e3b expref: -99 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787383672.647344:0:24167:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a894f77, atime: 0x6a894f75, ctime: 0x6a894f77, blocks: 0x0 00010000:00010000:1.0:1787383672.647367:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=705s v=(0 0) 00010000:00010000:1.0:1787383672.647372:0:24167:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787383672.647380:0:24167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec915330716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e3b expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.647396:0:24167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000120a8ba7/0xc40acec915330716 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e3b expref: 8 pid: 24167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383672.647408:0:24167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff963605828e00, rc 0) 00000100:00100000:1.0:1787383672.647466:0:24167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963636928a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:18814:x1874206966063232:12345-192.168.203.2@tcp:101:bash.0 Request processed in 221us (10243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383672.647473:0:24167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 27 00010000:00010000:2.0:1787383672.650276:0:22647:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787383672.650288:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.650299:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636113c8600 already unused, calling callback (ffffffffc0ca5e90) 00010000:00010000:2.0:1787383672.650305:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.650315:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.650340:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:2.0:1787383672.650343:0:22647:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787383672.650348:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.650356:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c8600/0xc40acec91533070f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 25710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.650371:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383672.650373:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787383672.650375:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787383672.651443:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.652164:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966063616 00000100:00100000:2.0:1787383672.652174:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966063616 00000100:00100000:2.0:1787383672.652237:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:2.0:1787383672.652247:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+20:18814:x1874206966063616:12345-192.168.203.2@tcp:101:bash.0 00010000:00010000:2.0:1787383672.652269:0:22661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787383672.652286:0:22661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91533071d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e42 expref: -99 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.652317:0:22661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330724 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.652329:0:22661:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330724 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.652340:0:22661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330724 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22661 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.652444:0:22661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec91533071d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e42 expref: 22 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.652461:0:22661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6200/0xc40acec915330724 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e42 expref: 21 pid: 22661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.652469:0:22661:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383672.652473:0:22661:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787383672.652476:0:22661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636082a6200, rc 0) 00000100:00100000:2.0:1787383672.652544:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:18814:x1874206966063616:12345-192.168.203.2@tcp:101:bash.0 Request processed in 298us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383672.652551:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 71 00000100:00100000:1.0:1787383672.657654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.657889:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966063872 00000100:00100000:2.0:1787383672.657898:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966063872 00000100:00100000:2.0:1787383672.658010:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 14 00000100:00100000:2.0:1787383672.658020:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363692ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+21:18814:x1874206966063872:12345-192.168.203.2@tcp:35:bash.0 00000001:00080000:2.0:1787383672.658228:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1787383672.658336:0:22662:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1787383672.658434:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363692ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+24:18814:x1874206966063872:12345-192.168.203.2@tcp:35:bash.0 Request processed in 415us (786us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1787383672.658443:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 14 00000020:00080000:2.0:1787383672.658447:0:22662:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787383672.850404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.850812:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966064128 00000100:00100000:3.0:1787383672.850822:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966064128 00000100:00100000:3.0:1787383672.850882:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:3.0:1787383672.850893:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+24:18825:x1874206966064128:12345-192.168.203.2@tcp:101:lfs.0 00010000:00010000:3.0:1787383672.850925:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787383672.850943:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91533072b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd2498fb3f3402e49 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787383672.851050:0:22660:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787383672.851135:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91533072b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e49 expref: 26 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.851149:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9635036bc900) 00010000:00010000:3.0:1787383672.851152:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787383672.851157:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636113c9a00/0xc40acec91533072b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.2@tcp remote: 0xd2498fb3f3402e49 expref: 26 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787383672.851170:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9636113c9a00, rc 0) 00000100:00100000:3.0:1787383672.851232:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+25:18825:x1874206966064128:12345-192.168.203.2@tcp:101:lfs.0 Request processed in 341us (836us total) trans 12884901930 rc 301/301 00000100:00100000:3.0:1787383672.851240:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 72 00000100:00100000:3.0:1787383672.864087:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:2.0:1787383672.864176:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966064256 00000100:00100000:2.0:1787383672.864185:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966064256 00000100:00100000:2.0:1787383672.864239:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:2.0:1787383672.864247:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+25:18825:x1874206966064256:12345-192.168.203.2@tcp:34:lfs.0 00010000:00010000:2.0:1787383672.864317:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864332:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864343:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864357:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864364:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864380:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864459:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864468:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864475:0:22659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787383672.864522:0:22659:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864533:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864540:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864548:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864553:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a7800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.864557:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864564:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864595:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9635036bc200) 00010000:00010000:2.0:1787383672.864598:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.864602:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864615:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a7800/0xc40acec915330739 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864628:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864634:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864639:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864644:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.864647:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864653:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864659:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9635032cd600) 00010000:00010000:2.0:1787383672.864662:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.864664:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864669:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6800/0xc40acec915330740 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864682:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864687:0:22659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864699:0:22659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864703:0:22659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9636082a6600 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:2.0:1787383672.864706:0:22659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864711:0:22659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864717:0:22659:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff96363d897600) 00010000:00010000:2.0:1787383672.864719:0:22659:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787383672.864721:0:22659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787383672.864737:0:22659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9636082a6600/0xc40acec915330747 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22659 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787383672.864854:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+25:18825:x1874206966064256:12345-192.168.203.2@tcp:34:lfs.0 Request processed in 606us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383672.864862:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 73 00000100:00100000:1.0:1787383672.867670:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:3.0:1787383672.867853:0:25710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966064512 00000100:00100000:3.0:1787383672.867862:0:25710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966064512 00000100:00100000:3.0:1787383672.867914:0:25710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 15 00000100:00100000:3.0:1787383672.867923:0:25710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+25:18825:x1874206966064512:12345-192.168.203.2@tcp:35:lfs.0 00000100:00100000:3.0:1787383672.868121:0:25710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+26:18825:x1874206966064512:12345-192.168.203.2@tcp:35:lfs.0 Request processed in 198us (458us total) trans 12884901931 rc 0/0 00000100:00100000:3.0:1787383672.868128:0:25710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 15 00010000:00010000:1.0:1787383673.053605:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787383673.243526:0:23419:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787383674.077738:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787383675.011366:0:25749:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1787383675.103236:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383675.452951:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.452990:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453014:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453044:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453069:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453085:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453134:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.453167:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065024 00000100:00100000:0.0:1787383675.453176:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065024 00000100:00100000:0.0:1787383675.453219:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065536 00000100:00100000:0.0:1787383675.453221:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065536 00000100:00100000:0.0:1787383675.453243:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065152 00000100:00100000:0.0:1787383675.453245:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065152 00000100:00100000:0.0:1787383675.453255:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065664 00000100:00100000:0.0:1787383675.453257:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065664 00000100:00100000:0.0:1787383675.453270:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383675.453277:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2404:x1874206966065024:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453347:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2404:x1874206966065024:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 70us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453355:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 21 00000100:00100000:0.0:1787383675.453369:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1787383675.453387:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966065536:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453409:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966065536:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 23us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453415:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 22 00000100:00100000:0.0:1787383675.453425:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1787383675.453430:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966065152:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453446:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966065152:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 17us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453452:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 23 00000100:00100000:0.0:1787383675.453460:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383675.453465:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966065664:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453481:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966065664:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 16us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453496:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 24 00000100:00100000:0.0:1787383675.453512:0:22653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966064640 00000100:00100000:0.0:1787383675.453515:0:22653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966064640 00000100:00100000:0.0:1787383675.453537:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:0.0:1787383675.453543:0:22653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+13:2404:x1874206966064640:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453576:0:22653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edeae43f-301c-483b-b410-d06772b42fd6+13:2404:x1874206966064640:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 33us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453582:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 166 00000100:00100000:0.0:1787383675.453605:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966064768 00000100:00100000:0.0:1787383675.453607:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966064768 00000100:00100000:0.0:1787383675.453629:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065280 00000100:00100000:0.0:1787383675.453636:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065280 00000100:00100000:0.0:1787383675.453650:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966064896 00000100:00100000:0.0:1787383675.453653:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966064896 00000100:00100000:0.0:1787383675.453664:0:25711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065408 00000100:00100000:0.0:1787383675.453665:0:25711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065408 00000100:00100000:0.0:1787383675.453677:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1787383675.453683:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+26:2404:x1874206966064768:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453709:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+26:2404:x1874206966064768:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453715:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 61 00000100:00100000:0.0:1787383675.453725:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:0.0:1787383675.453730:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8056f36d-71ba-4e9d-a187-445657578982+6:2404:x1874206966065280:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453746:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8056f36d-71ba-4e9d-a187-445657578982+6:2404:x1874206966065280:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 17us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453751:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 62 00000100:00100000:0.0:1787383675.453760:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:0.0:1787383675.453795:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966064896:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453815:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+5:2404:x1874206966064896:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 50us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453820:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 63 00000100:00100000:0.0:1787383675.453830:0:25711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00100000:0.0:1787383675.453835:0:25711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966065408:12345-192.168.203.2@tcp:400:kworker.0 00000100:00100000:0.0:1787383675.453849:0:25711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8056f36d-71ba-4e9d-a187-445657578982+5:2404:x1874206966065408:12345-192.168.203.2@tcp:400:kworker.0 Request processed in 14us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.453855:0:25711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 64 00000100:00080000:0.0:1787383675.453879:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383675.453882:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383675.453885:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787383675.453887:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787383675.964524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:1.0:1787383675.964579:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.2@tcp (source: 12345-192.168.203.2@tcp) 00000100:00100000:0.0:1787383675.964748:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065920 00000100:00100000:0.0:1787383675.964759:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065920 00000100:00100000:0.0:1787383675.964860:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:0.0:1787383675.964870:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363ca50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2404:x1874206966065920:12345-192.168.203.2@tcp:16:kworker.0 00000100:00100000:0.0:1787383675.964985:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363ca50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2404:x1874206966065920:12345-192.168.203.2@tcp:16:kworker.0 Request processed in 116us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383675.964993:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 28 00000100:00100000:2.0:1787383675.965479:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206966065792 00000100:00100000:2.0:1787383675.965495:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206966065792 00002000:00100000:2.0:1787383675.965530:0:24172:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9635031f1880 x1874206966065792/t0(0) o4->f20c8c43-0216-4a1c-8d1c-d6c7feee2f60@192.168.203.2@tcp:461/0 lens 504/0 e 0 to 0 dl 1787383686 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787383675.965542:0:24172:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9635031f1880 with x1874206966065792 ext(0->8) 00002000:00010000:2.0:1787383675.965555:0:24172:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9635031f1880 00000100:00100000:2.0:1787383675.965578:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.2@tcp, seq: 0 00000100:00100000:2.0:1787383675.965586:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635031f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+8:2404:x1874206966065792:12345-192.168.203.2@tcp:4:bash.0 00000100:00100000:2.0:1787383675.966728:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635031f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f20c8c43-0216-4a1c-8d1c-d6c7feee2f60+10:2404:x1874206966065792:12345-192.168.203.2@tcp:4:bash.0 Request processed in 1138us (2213us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787383675.966737:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.2@tcp, seq: 0 00002000:00100000:2.0:1787383675.966744:0:24172:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9635031f1880 x1874206966065792/t12884901895(0) o4->f20c8c43-0216-4a1c-8d1c-d6c7feee2f60@192.168.203.2@tcp:461/0 lens 504/448 e 0 to 0 dl 1787383686 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1787383675.966754:0:24172:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9635031f1880 with x1874206966065792 ext(0->8) 00002000:00010000:2.0:1787383675.966758:0:24172:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9635031f1880 00000100:00100000:0.0:1787383676.059127:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985041152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787383676.059197:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383676.059298:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041152 00000100:00100000:1.0:1787383676.059306:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041152 00000100:00100000:1.0:1787383676.059375:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787383676.059384:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985041152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787383676.059406:0:25506:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787383676.059464:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1874206985041152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383676.059471:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787383676.059582:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383676.059615:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1874206985041152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787383676.123044:0:25118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383677.083107:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787383677.083128:0:3650:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985041280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787383677.083195:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787383677.083333:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041280 00000100:00100000:1.0:1787383677.083340:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041280 00000100:00100000:1.0:1787383677.083393:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787383677.083401:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206985041280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787383677.083427:0:24170:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923501056 avail 3691978752 00000100:00100000:1.0:1787383677.083465:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1874206985041280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383677.083471:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787383677.083689:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787383677.083722:0:3650:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1874206985041280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787383677.084650:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787383677.084661:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985041408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383677.084691:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.084722:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041408 00000100:00100000:3.0:1787383677.084738:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041408 00000100:00100000:3.0:1787383677.084778:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383677.084785:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985041408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787383677.084812:0:24171:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787383677.085053:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985041536:0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.085111:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985042048:0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.085147:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206985042560:0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085175:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.085189:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787383677.085194:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985041664:0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085213:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.085226:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985042176:0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.085274:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206985042688:0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.085310:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041664 00000100:00100000:2.0:1787383677.085313:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041664 00000100:00100000:2.0:1787383677.085338:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787383677.085344:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985041664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085383:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1874206985041664:12345-0@lo:400:kworker.0 Request processed in 39us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383677.085390:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787383677.085410:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042048 00000100:00100000:2.0:1787383677.085413:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042048 00000100:00100000:2.0:1787383677.085431:0:24168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042176 00000100:00100000:2.0:1787383677.085433:0:24168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042176 00000100:00100000:2.0:1787383677.085447:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787383677.085452:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985042048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.085477:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985042048:12345-0@lo:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383677.085482:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787383677.085682:0:22652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041536 00000100:00100000:1.0:1787383677.085686:0:22652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041536 00000100:00100000:1.0:1787383677.085708:0:22652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787383677.085714:0:22652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636369bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985041536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787383677.085742:0:22652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636369bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c79c93-7083-4972-b8c3-d0fe8d8c1db6+24:3647:x1874206985041536:12345-0@lo:400:kworker.0 Request processed in 28us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787383677.085747:0:22652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787383677.085873:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042560 00000100:00100000:0.0:1787383677.085876:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042560 00000100:00100000:0.0:1787383677.085899:0:22659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042688 00000100:00100000:0.0:1787383677.085901:0:22659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042688 00000100:00100000:0.0:1787383677.085917:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383677.085924:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206985042560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383677.085951:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1874206985042560:12345-0@lo:400:kworker.0 Request processed in 28us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383677.085962:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787383677.085974:0:22659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787383677.085979:0:22659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff96363d133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206985042688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787383677.086002:0:22659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff96363d133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1874206985042688:12345-0@lo:400:kworker.0 Request processed in 24us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787383677.086007:0:22659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787383677.086023:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787383677.086035:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787383677.086037:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787383677.086090:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787383677.086098:0:24168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985042176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787383677.086123:0:24168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636084b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985042176:12345-0@lo:400:kworker.0 Request processed in 28us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087064:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1874206985041408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2279us (2371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087073:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787383677.087101:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985041792:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.087140:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985042304:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087168:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.087182:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963504691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206985042816:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087199:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.087229:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9636409a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1874206985041408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787383677.087246:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787383677.087251:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff963503d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985041920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087269:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.087284:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985042432:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087300:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.087312:0:3649:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985042944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787383677.087327:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.087350:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041920 00000100:00100000:3.0:1787383677.087353:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041920 00000100:00100000:3.0:1787383677.087376:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787383677.087381:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985041920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087420:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1874206985041920:12345-0@lo:400:kworker.0 Request processed in 39us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087426:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787383677.087440:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985041792 00000100:00100000:3.0:1787383677.087442:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985041792 00000100:00100000:3.0:1787383677.087457:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042304 00000100:00100000:3.0:1787383677.087459:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042304 00000100:00100000:3.0:1787383677.087469:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042816 00000100:00100000:3.0:1787383677.087471:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042816 00000100:00100000:3.0:1787383677.087485:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042432 00000100:00100000:3.0:1787383677.087487:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042432 00000100:00100000:3.0:1787383677.087513:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383677.087518:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087555:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1874206985041792:12345-0@lo:400:kworker.0 Request processed in 36us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087560:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787383677.087571:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383677.087576:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9636409a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985042304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087596:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9636409a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1874206985042304:12345-0@lo:400:kworker.0 Request processed in 21us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087602:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787383677.087610:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787383677.087615:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206985042816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087648:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1874206985042816:12345-0@lo:400:kworker.0 Request processed in 33us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087655:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787383677.087666:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787383677.087676:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985042432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087700:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1874206985042432:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.087706:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787383677.087719:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787383677.087722:0:22655:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787383677.087735:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985041920:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087744:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1874206985042432:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087751:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1874206985041792:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.087759:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1874206985042304:0@lo:400:kworker.0 00010000:00080000:3.0:1787383677.087783:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff963504691180 x1874206985042816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383677.087793:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1874206985042816:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.088267:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1874206985041664:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.088278:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985042176:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.088288:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963504691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1874206985042688:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.088296:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363ca50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c79c93-7083-4972-b8c3-d0fe8d8c1db6:3647:1874206985041536:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.088305:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff963503d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985042048:0@lo:400:kworker.0 00010000:00080000:3.0:1787383677.088315:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96362d919f80 x1874206985042560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787383693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787383677.088324:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96362d919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1874206985042560:0@lo:400:kworker.0 00000100:00100000:3.0:1787383677.088389:0:25506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985042944 00000100:00100000:3.0:1787383677.088393:0:25506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985042944 00000100:00100000:3.0:1787383677.088413:0:25506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383677.088419:0:25506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206985042944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787383677.088431:0:25506:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787383677.088462:0:25506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963503f22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1874206985042944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.088467:0:25506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787383677.088489:0:3649:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1874206985042944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787383677.103147:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1787383677.159435:0:22648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787383677.595023:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787383677.595045:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9635044a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985043072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787383677.595111:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787383677.596847:0:23728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985043072 00000100:00100000:2.0:1787383677.596855:0:23728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985043072 00000100:00100000:2.0:1787383677.596910:0:23728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787383677.596920:0:23728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9635044a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985043072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787383677.596952:0:23728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787383677.597018:0:23728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9635044a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1874206985043072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787383677.597025:0:23728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787383677.597177:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787383677.597190:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985043200:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787383677.597225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787383677.597294:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874206985043200 00000100:00100000:3.0:1787383677.597299:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874206985043200 00000100:00100000:3.0:1787383677.597332:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787383677.597340:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985043200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787383677.597359:0:22665:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1787383677.597414:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff963504691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1874206985043200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787383677.597421:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787383677.597554:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff96363d130e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1874206985043200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787383677.599675:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9635044a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1874206985043072:0@lo:41:osp-pre-1-0.0 00000001:00080000:3.0:1787383678.116971:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1787383678.116987:0:24163:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:2.0:1787383678.124281:0:22639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901931 is committed 00000020:00080000:2.0:1787383678.124310:0:22639:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9636082f6600 refcount 2 committed 0 result 0 batchid 8589934629 00000020:00080000:2.0:1787383678.124328:0:22639:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963627bffb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9636082f6300 00000020:00080000:2.0:1787383678.124332:0:22639:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff963627bff000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9635035e2c00 00010000:00010000:1.0:1787383678.124440:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383678.124452:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383678.124467:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383678.124482:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff963610f17800 already unused, calling callback (ffffffffc18af4f0) 00010000:00010000:1.0:1787383678.124487:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383678.124495:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383678.124515:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff96363d897b00) 00010000:00010000:1.0:1787383678.124518:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787383678.124523:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787383678.124541:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff963610f17800/0xc40acec9153306e5 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23412 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787383678.124567:0:22699:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934629 committed batchid 4294967529 00000020:00080000:1.0:1787383678.124638:0:22699:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1787383678.174116:0:22647:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14603 lines, 14603 kept, 0 dropped, 0 bad.