00010000:00010000:2.0F:1783967143.479898:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1783967143.799066:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587999104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967143.799171:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1783967143.799267:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999104 00000100:00100000:1.0:1783967143.799289:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999104 00000100:00080000:0.0:1783967143.799347:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967143.799366:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783967143.799396:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587999104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783967143.799424:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923505152 avail 3691954176 00000100:00100000:0.0:1783967143.799469:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624587999104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:3.0F:1783967143.806577:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1783967143.806601:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a04c274aa00, transno 8589934596 00000004:00080000:3.0:1783967143.806628:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1783967143.806668:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624587999104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967143.812285:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1783967144.509599:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967144.724069:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967144.724110:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967144.724130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967144.724156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967144.724182:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806336 00000100:00100000:2.0:1783967144.724191:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806336 00000100:00080000:1.0:1783967144.724235:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783967144.724252:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806208 00000100:00100000:2.0:1783967144.724255:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806208 00000100:00100000:2.0:1783967144.724286:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1783967144.724297:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2401:x1870624563806336:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967144.724377:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2401:x1870624563806336:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967144.724385:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 82 00000100:00100000:2.0:1783967144.724404:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:2.0:1783967144.724410:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+26:2401:x1870624563806208:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967144.724440:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+26:2401:x1870624563806208:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967144.724446:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 83 00000100:00100000:2.0:1783967144.724467:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806464 00000100:00100000:2.0:1783967144.724470:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806464 00000100:00100000:2.0:1783967144.724498:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1783967144.724504:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2401:x1870624563806464:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967144.724529:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2401:x1870624563806464:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967144.724535:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00080000:1.0:1783967144.724797:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783967144.724801:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967144.726005:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806080 00000100:00100000:3.0:1783967144.726014:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806080 00000100:00100000:3.0:1783967144.726141:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:3.0:1783967144.726150:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:2401:x1870624563806080:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967144.726206:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419db461-1825-4e92-8b20-56544c55f6b4+13:2401:x1870624563806080:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 57us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967144.726213:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 172 00000100:00100000:3.0:1783967144.726288:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967144.726380:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967144.726401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967144.726423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967144.726445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967144.726465:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806592 00000100:00100000:3.0:1783967144.726469:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806592 00000100:00100000:3.0:1783967144.726499:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806976 00000100:00100000:3.0:1783967144.726502:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806976 00000100:00100000:3.0:1783967144.726515:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563807104 00000100:00100000:3.0:1783967144.726517:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563807104 00000100:00100000:3.0:1783967144.726530:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1783967144.726536:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2399:x1870624563806592:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1783967144.726555:0:18604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068434 00000100:00080000:3.0:1783967144.726568:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783967144.726627:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783967144.726785:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+2:2399:x1870624563806592:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 230us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967144.726799:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:3.0:1783967144.726814:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:3.0:1783967144.726821:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2399:x1870624563806976:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1783967144.726833:0:18604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606846c 00000100:00080000:3.0:1783967144.726840:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9a04c2495800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783967144.726865:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1783967144.726951:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+2:2399:x1870624563806976:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 117us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967144.726960:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:3.0:1783967144.726973:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1783967144.726979:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2399:x1870624563807104:12345-192.168.204.59@tcp:9:kworker.0 00000020:00000080:3.0:1783967144.726992:0:18604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068473 00000100:00080000:3.0:1783967144.726997:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783967144.727020:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1783967144.727070:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+2:2399:x1870624563807104:12345-192.168.204.59@tcp:9:kworker.0 Request processed in 90us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967144.727077:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00010000:00010000:3.0:1783967144.727098:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967144.727104:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967144.727108:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967144.727120:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806720 00000100:00100000:3.0:1783967144.727125:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806720 00000100:00100000:3.0:1783967144.727155:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563806848 00000100:00100000:3.0:1783967144.727157:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563806848 00000100:00100000:3.0:1783967144.727172:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1783967144.727178:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2401:x1870624563806720:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967144.727215:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2401:x1870624563806720:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 37us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967144.727222:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 84 00000100:00100000:3.0:1783967144.727235:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00100000:3.0:1783967144.727241:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2401:x1870624563806848:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967144.727264:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2401:x1870624563806848:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967144.727270:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 85 00000100:00080000:3.0:1783967144.727328:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967144.727332:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967144.727334:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967144.727336:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1783967144.838583:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00010000:00010000:2.0:1783967144.838613:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783967144.838621:0:17076:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a05ea657900 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1783967144.838627:0:17076:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a04c3c5a600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a05ea657180 00000020:00080000:1.0:1783967144.838634:0:17076:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a04c3c5af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a04c1fcfe00 00010000:00010000:2.0:1783967144.838641:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967144.838650:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967144.838657:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967144.838663:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967144.838671:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783967144.838675:0:17135:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:2.0:1783967144.838695:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:2.0:1783967144.838700:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967144.838704:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967144.838711:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631800/0x9269c8b316068775 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17096 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783967144.838758:0:17135:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1783967145.530907:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967145.847121:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587999232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967145.847201:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.847414:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587999360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967145.847451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967145.847530:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999232 00000100:00100000:2.0:1783967145.847539:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999232 00000100:00100000:2.0:1783967145.847601:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999360 00000100:00100000:2.0:1783967145.847605:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999360 00000100:00100000:2.0:1783967145.847627:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783967145.847636:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587999232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783967145.847667:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783967145.847713:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624587999232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967145.847728:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783967145.847745:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783967145.847751:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587999360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783967145.847792:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967145.847824:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624587999360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967145.847830:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1783967145.848078:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783967145.848083:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783967145.848121:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624587999360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967145.848153:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624587999232:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967145.852271:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587999488:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.852396:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588000000:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.852445:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624588000512:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.852494:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1783967145.852501:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587999616:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.852560:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588000128:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.852615:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624588000640:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852637:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.852670:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999488 00000100:00100000:0.0:1783967145.852677:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999488 00000100:00100000:0.0:1783967145.852724:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783967145.852733:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587999488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.852816:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3b28c549-2862-472c-a00b-4682deda9da4+24:3647:x1870624587999488:12345-0@lo:400:kworker.0 Request processed in 83us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.852823:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783967145.852859:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000000 00000100:00100000:0.0:1783967145.852863:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000000 00000100:00100000:0.0:1783967145.854030:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000512 00000100:00100000:0.0:1783967145.854041:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000512 00000100:00100000:0.0:1783967145.854086:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000640 00000100:00100000:0.0:1783967145.854089:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000640 00000100:00100000:0.0:1783967145.854108:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783967145.854116:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588000000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854188:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588000000:12345-0@lo:400:kworker.0 Request processed in 73us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.854197:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783967145.854211:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783967145.854217:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624588000512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854245:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624588000512:12345-0@lo:400:kworker.0 Request processed in 28us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.854259:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783967145.854272:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783967145.854277:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624588000640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854305:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624588000640:12345-0@lo:400:kworker.0 Request processed in 27us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.854310:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783967145.854335:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999616 00000100:00100000:0.0:1783967145.854339:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999616 00000100:00100000:0.0:1783967145.854356:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000128 00000100:00100000:0.0:1783967145.854358:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000128 00000100:00100000:0.0:1783967145.854369:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783967145.854374:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587999616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854402:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624587999616:12345-0@lo:400:kworker.0 Request processed in 27us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.854407:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783967145.854416:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783967145.854422:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588000128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854443:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588000128:12345-0@lo:400:kworker.0 Request processed in 21us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.854449:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1783967145.854473:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783967145.854478:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967145.854492:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587999744:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854523:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.854550:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588000256:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.854569:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967145.854826:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587999872:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.859173:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967145.859224:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624588000384:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.859265:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967145.859295:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967145.859318:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967145.859355:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999744 00000100:00100000:1.0:1783967145.859362:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999744 00000100:00100000:1.0:1783967145.859414:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624587999872 00000100:00100000:1.0:1783967145.859418:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624587999872 00000100:00100000:1.0:1783967145.859439:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783967145.859447:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587999744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.859497:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624587999744:12345-0@lo:400:kworker.0 Request processed in 50us (4972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967145.859504:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783967145.859519:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967145.859525:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587999872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.859568:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624587999872:12345-0@lo:400:kworker.0 Request processed in 42us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967145.859574:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967145.860119:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624587999872:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.860154:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624587999616:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.860165:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588000128:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.860175:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624588000640:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.860185:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624587999488:0@lo:400:kworker.0 00000100:00100000:1.0:1783967145.860196:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588000000:0@lo:400:kworker.0 00010000:00080000:1.0:1783967145.860209:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c370ad80 x1870624588000512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967145.860219:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624588000512:0@lo:400:kworker.0 00000100:00100000:2.0:1783967145.860630:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000896 00000100:00100000:2.0:1783967145.860636:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000896 00000100:00100000:2.0:1783967145.860676:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783967145.860683:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588000896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783967145.860703:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1783967145.860794:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588000896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967145.860802:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783967145.860838:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967145.866751:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588000768:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.866849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967145.866939:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624587999744:0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.866990:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000256 00000100:00100000:0.0:1783967145.866996:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000256 00000100:00100000:0.0:1783967145.867050:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000384 00000100:00100000:0.0:1783967145.867054:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000384 00000100:00100000:0.0:1783967145.867071:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588000768 00000100:00100000:0.0:1783967145.867074:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588000768 00000100:00100000:0.0:1783967145.867090:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783967145.867099:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588000256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.867158:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588000256:12345-0@lo:400:kworker.0 Request processed in 59us (12587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.867165:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783967145.867182:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783967145.867187:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624588000384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.867216:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624588000384:12345-0@lo:400:kworker.0 Request processed in 29us (7951us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.867222:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783967145.867232:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783967145.867238:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624588000768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967145.867280:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624588000768:12345-0@lo:400:kworker.0 Request processed in 42us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967145.867287:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1783967145.867307:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967145.867311:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783967145.867313:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783967145.867322:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967145.867347:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588000256:0@lo:400:kworker.0 00010000:00080000:0.0:1783967145.867360:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05fba41500 x1870624588000768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967145.867370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588000768:0@lo:400:kworker.0 00000100:00100000:2.0:1783967145.867717:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624588000384:0@lo:400:kworker.0 00000100:00100000:3.0:1783967146.055858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967146.055943:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563807232 00000100:00100000:0.0:1783967146.055953:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563807232 00000100:00100000:0.0:1783967146.056040:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00100000:0.0:1783967146.056052:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+12:15576:x1870624563807232:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783967146.056165:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+12:15576:x1870624563807232:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 115us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967146.056174:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 74 00000100:00080000:1.0:1783967146.056689:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967146.062659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967146.062806:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563807360 00000100:00100000:1.0:1783967146.062816:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563807360 00000100:00100000:1.0:1783967146.064558:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00100000:1.0:1783967146.064631:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:15576:x1870624563807360:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783967146.064741:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:15576:x1870624563807360:12345-192.168.204.59@tcp:60:lhsmtool_posix.0 Request processed in 171us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967146.064749:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 75 00000100:00080000:0.0:1783967146.065347:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783967146.079033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967146.082758:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563807616 00000100:00100000:3.0:1783967146.082786:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563807616 00000100:00100000:3.0:1783967146.082843:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1783967146.082855:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ed251850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+12:15576:x1870624563807616:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783967146.083408:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ed251850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+13:15576:x1870624563807616:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 553us (4382us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1783967146.083672:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:1.0:1783967146.359904:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588001024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967146.359998:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967146.360326:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783967146.360334:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588001152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967146.360362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967146.360577:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001024 00000100:00100000:2.0:1783967146.360594:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001024 00000100:00100000:2.0:1783967146.360637:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001152 00000100:00100000:2.0:1783967146.360640:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001152 00000100:00100000:2.0:1783967146.360658:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783967146.360667:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588001024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967146.360706:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967146.360937:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588001024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 270us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967146.360945:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783967146.361139:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783967146.361148:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588001152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967146.361167:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783967146.361318:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588001152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967146.361325:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783967146.361510:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588001152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967146.361524:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1d86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588001024:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783967146.551489:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967147.255502:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783967147.580401:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967148.215165:0:17131:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783967148.215175:0:17131:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783967148.215196:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783967148.215205:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783967148.599289:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967148.922427:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967148.922458:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588001280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783967148.922542:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967148.922662:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001280 00000100:00100000:3.0:1783967148.922672:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001280 00000100:00100000:3.0:1783967148.922749:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783967148.922761:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588001280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783967148.922809:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1783967148.923165:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588001280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 406us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967148.923173:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783967148.923260:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588001280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783967148.923357:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783967149.626937:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967149.828674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967149.829465:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967149.829490:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967149.836188:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563807872 00000100:00100000:3.0:1783967149.836281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967149.836334:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563807872 00000100:00100000:3.0:1783967149.836415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967149.838863:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563807744 00000100:00100000:2.0:1783967149.838885:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563807744 00000100:00100000:2.0:1783967149.839029:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:2.0:1783967149.839043:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:2403:x1870624563807744:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967149.839143:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419db461-1825-4e92-8b20-56544c55f6b4+13:2403:x1870624563807744:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 103us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967149.839151:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 174 00000100:00100000:2.0:1783967149.839197:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808128 00000100:00100000:2.0:1783967149.839202:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808128 00000100:00100000:2.0:1783967149.839244:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1783967149.839251:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563808128:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967149.839283:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2403:x1870624563808128:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 33us (9822us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967149.839291:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1783967149.839485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967149.840132:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808384 00000100:00100000:0.0:1783967149.840141:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808384 00000100:00100000:0.0:1783967149.840190:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808000 00000100:00100000:0.0:1783967149.840193:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808000 00000100:00100000:0.0:1783967149.840209:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:0.0:1783967149.840217:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+13:2403:x1870624563807872:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967149.840283:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+13:2403:x1870624563807872:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 68us (11625us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967149.840290:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 92 00000100:00100000:0.0:1783967149.840305:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1783967149.840311:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563808384:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967149.840334:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563808384:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 24us (10843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967149.840340:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 93 00000100:00100000:0.0:1783967149.840353:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00100000:0.0:1783967149.840359:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563808000:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967149.840381:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2403:x1870624563808000:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 23us (3967us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967149.840387:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 94 00000100:00080000:0.0:1783967149.840412:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967149.840418:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783967149.840420:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967149.842748:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808256 00000100:00100000:1.0:1783967149.842891:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808256 00000100:00080000:2.0:1783967149.843106:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967149.844869:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 95 00000100:00100000:0.0:1783967149.844899:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2403:x1870624563808256:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967149.845038:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2403:x1870624563808256:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 153us (5552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967149.845047:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 95 00000001:02000400:1.0:1783967149.983942:0:20472:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:25:47 (1783967147) 00010000:00010000:3.0:1783967150.654702:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967150.970507:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588001408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967150.970610:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.970711:0:20236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001408 00000100:00100000:1.0:1783967150.970721:0:20236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001408 00000100:00100000:1.0:1783967150.970845:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783967150.970860:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588001408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967150.970905:0:20236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967150.970961:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588001408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.970970:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1783967150.970999:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783967150.971187:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588001408:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1783967150.972851:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:1.0:1783967150.972870:0:17076:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000100:00100000:2.0:1783967150.973165:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588001664:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.974563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967150.974634:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588002176:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.974689:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967150.974710:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624588002688:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.974741:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967150.974789:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1783967150.974796:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588001536:0@lo:400:kworker.0 00000020:00080000:3.0:1783967150.974948:0:17135:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1783967150.974962:0:17135:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:1.0:1783967150.975127:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783967150.975138:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588003200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783967150.975377:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967150.975969:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001536 00000100:00100000:3.0:1783967150.975980:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001536 00000100:00100000:3.0:1783967150.976051:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783967150.976062:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624588001536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976230:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003200 00000100:00100000:1.0:1783967150.976234:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003200 00000100:00100000:1.0:1783967150.976277:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967150.976284:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588003200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783967150.976303:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967150.976344:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588003200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.976352:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967150.976383:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588001792:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976436:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588002304:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976457:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976476:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624588002816:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783967150.976531:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588001920:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976568:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588002432:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976605:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588002944:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976628:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967150.976649:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001792 00000100:00100000:1.0:1783967150.976667:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001792 00000100:00100000:1.0:1783967150.976703:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002304 00000100:00100000:1.0:1783967150.976706:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002304 00000100:00100000:1.0:1783967150.976721:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001920 00000100:00100000:1.0:1783967150.976723:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001920 00000100:00100000:1.0:1783967150.976741:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967150.976747:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588001792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976805:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588001792:12345-0@lo:400:kworker.0 Request processed in 58us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.976812:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967150.976835:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783967150.976841:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588002304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976867:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588002304:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.976873:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783967150.976882:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783967150.976887:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588001920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.976909:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588001920:12345-0@lo:400:kworker.0 Request processed in 22us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.976915:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783967150.976939:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002688 00000100:00100000:1.0:1783967150.976943:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002688 00000100:00100000:1.0:1783967150.976966:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002816 00000100:00100000:1.0:1783967150.976968:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002816 00000100:00100000:1.0:1783967150.976979:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002432 00000100:00100000:1.0:1783967150.976981:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002432 00000100:00100000:1.0:1783967150.976990:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002944 00000100:00100000:1.0:1783967150.976992:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002944 00000100:00100000:1.0:1783967150.977004:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783967150.977017:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624588002688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977049:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624588002688:12345-0@lo:400:kworker.0 Request processed in 33us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.977055:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783967150.977067:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783967150.977073:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624588002816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977099:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624588002816:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.977105:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783967150.977117:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783967150.977123:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588002432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977150:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588002432:12345-0@lo:400:kworker.0 Request processed in 28us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.977157:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783967150.977167:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783967150.977173:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624588002944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977219:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624588002944:12345-0@lo:400:kworker.0 Request processed in 46us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967150.977226:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1783967150.977256:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783967150.977261:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783967150.977263:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783967150.977265:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783967150.977308:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588003200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967150.977349:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588001920:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977370:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588002432:0@lo:400:kworker.0 00010000:00080000:1.0:1783967150.977383:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c6bd4a80 x1870624588002944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967150.977392:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588002944:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977401:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588001792:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977411:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588002304:0@lo:400:kworker.0 00000100:00100000:1.0:1783967150.977419:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624588002816:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.977557:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588002048:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.977588:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967150.977614:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588002560:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.977636:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967150.977656:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588003072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967150.977678:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783967150.977705:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c1f10380 x1870624588002688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967150.977715:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624588002688:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.977742:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588001664 00000100:00100000:2.0:1783967150.977747:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588001664 00000100:00100000:2.0:1783967150.977786:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002176 00000100:00100000:2.0:1783967150.977790:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002176 00000100:00100000:2.0:1783967150.977805:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783967150.977811:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588001664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.977864:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588001664:12345-0@lo:400:kworker.0 Request processed in 52us (3308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967150.977871:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783967150.977885:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783967150.977900:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588002176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.977937:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588002176:12345-0@lo:400:kworker.0 Request processed in 39us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967150.977944:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783967150.977971:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002048 00000100:00100000:2.0:1783967150.977975:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002048 00000100:00100000:2.0:1783967150.977995:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588002560 00000100:00100000:2.0:1783967150.977998:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588002560 00000100:00100000:2.0:1783967150.978026:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783967150.978033:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588002048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.978067:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588002048:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967150.978074:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783967150.978086:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783967150.978093:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624588002560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.978122:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624588002560:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967150.978129:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783967150.978133:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003072 00000100:00100000:0.0:1783967150.978140:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003072 00000100:00100000:2.0:1783967150.978161:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588002048:0@lo:400:kworker.0 00000100:00100000:2.0:1783967150.978172:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588002560:0@lo:400:kworker.0 00000100:00100000:0.0:1783967150.978180:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783967150.978188:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588001664:0@lo:400:kworker.0 00000100:00100000:0.0:1783967150.978193:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588003072:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967150.978204:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588002176:0@lo:400:kworker.0 00002000:00000024:0.0:1783967150.978228:0:18605:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1783967150.978277:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c6bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588003072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967150.978285:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783967150.978321:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588003072:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783967150.978344:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1783967150.978431:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000020:00000080:0.0:1783967150.978438:0:19416:0:(genops.c:906:class_export_put()) final put ffff9a05e77e2000/3b09368e-3456-41d0-9fd9-218c92aa494a 00000100:00100000:3.0:1783967150.979187:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624588001536:12345-0@lo:400:kworker.0 Request processed in 3123us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967150.979199:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783967150.979413:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588001536:0@lo:400:kworker.0 00000001:00100000:0.0:1783967150.979650:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000020:00000080:0.0:1783967150.979655:0:19416:0:(genops.c:906:class_export_put()) final put ffff9a05e77e3000/47e19328-a632-4b1f-8ff8-755b3236cab4 00000020:00000080:2.0:1783967150.980135:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05e77e2000/3b09368e-3456-41d0-9fd9-218c92aa494a for lustre-OST0001 00000020:00000080:2.0:1783967150.980200:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05e77e3000/47e19328-a632-4b1f-8ff8-755b3236cab4 for lustre-OST0001 00000020:00000080:2.0:1783967150.980234:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05e77e5800 for lustre-OST0001 00000020:00000080:2.0:1783967150.980240:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05e77e1800 for lustre-OST0001 00000001:00100000:3.0:1783967150.981124:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000020:00000080:3.0:1783967150.981131:0:18598:0:(genops.c:906:class_export_put()) final put ffff9a04c2492000/3b09368e-3456-41d0-9fd9-218c92aa494a 00000020:00000080:1.0:1783967150.981667:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c2492000/3b09368e-3456-41d0-9fd9-218c92aa494a for lustre-OST0000 00000020:00000080:1.0:1783967150.983259:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c2495800 for lustre-OST0000 00000100:00100000:0.0:1783967151.479859:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588003328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967151.479937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967151.479988:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783967151.479994:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588003456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967151.480017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967151.480060:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003328 00000100:00100000:0.0:1783967151.480068:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003328 00000100:00100000:0.0:1783967151.480106:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003456 00000100:00100000:0.0:1783967151.480109:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003456 00000100:00100000:0.0:1783967151.480127:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783967151.480145:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588003328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967151.480182:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967151.480228:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588003328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967151.480235:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783967151.480251:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783967151.480272:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588003456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967151.480287:0:17101:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1783967151.480316:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588003456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 46us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967151.480322:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783967151.480362:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588003456:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967151.480375:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1d84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588003328:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1783967151.676662:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967152.695641:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967153.719694:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967154.039247:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967154.039275:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588003584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967154.039359:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967154.039470:0:20236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003584 00000100:00100000:1.0:1783967154.039480:0:20236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003584 00000100:00100000:1.0:1783967154.039558:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967154.039569:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588003584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783967154.039599:0:20236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1783967154.039647:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588003584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967154.039655:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1783967154.039716:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967154.039757:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588003584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967154.548973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967154.549023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967154.549182:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808512 00000100:00100000:0.0:1783967154.549192:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808512 00000100:00100000:0.0:1783967154.549682:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1783967154.549694:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419db461-1825-4e92-8b20-56544c55f6b4+13:2401:x1870624563808512:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967154.549710:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967154.549853:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63800/0x9269c8b31606840a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fe3 expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967154.549874:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967154.549932:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419db461-1825-4e92-8b20-56544c55f6b4+12:2401:x1870624563808512:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 239us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967154.549940:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:1.0:1783967154.550055:0:18601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808768 00000100:00100000:1.0:1783967154.550060:0:18601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808768 00000100:00100000:3.0:1783967154.550347:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967154.550464:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967154.550488:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563809024 00000100:00100000:3.0:1783967154.550492:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563809024 00000100:00100000:3.0:1783967154.550522:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563808896 00000100:00100000:3.0:1783967154.550526:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563808896 00000100:00100000:1.0:1783967154.550526:0:18601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:1.0:1783967154.550535:0:18601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+6:2399:x1870624563808768:12345-192.168.204.59@tcp:9:umount.0 00000100:00100000:3.0:1783967154.550543:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783967154.550548:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+13:2401:x1870624563809024:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967154.550556:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1783967154.550566:0:18601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606842d 00010000:00010000:3.0:1783967154.550567:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068496 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70ca expref: 13 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.550577:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00010000:1.0:1783967154.550578:0:18601:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a05e77e0000: total 0 00000100:00080000:1.0:1783967154.550582:0:18601:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e5000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783967154.550602:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05cf065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+12:2401:x1870624563809024:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 53us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967154.550608:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783967154.550622:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000001:00000004:1.0:1783967154.550625:0:18601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1783967154.550627:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+11:2401:x1870624563808896:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967154.550634:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967154.550642:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d62600/0x9269c8b316068411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7014 expref: 11 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.550652:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967154.550669:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c443d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+10:2401:x1870624563808896:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967154.550684:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000020:00010000:3.0:1783967154.550829:0:17085:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a05e77e0000: total 0 00010000:00010000:3.0:1783967154.550875:0:17085:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a05e77e0000, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1783967154.550905:0:17085:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783967154.550907:0:17085:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1783967137 -> 1783967138 00002000:00010000:3.0:1783967154.550910:0:17085:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1783967137 -> 1783967138 00002000:00010000:3.0:1783967154.550913:0:17085:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1783967154.550932:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000affb4ddd/0x9269c8b3160687a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71aa expref: 4 pid: 18604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967154.550932:0:18601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+4:2399:x1870624563808768:12345-192.168.204.59@tcp:9:umount.0 Request processed in 399us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967154.550940:0:18601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00010000:00010000:3.0:1783967154.550954:0:17085:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a05e77e0000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783967154.550967:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967154.550969:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967154.550970:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783967154.551151:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967154.562863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967154.563068:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563809920 00000100:00100000:0.0:1783967154.563080:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563809920 00000100:00100000:0.0:1783967154.563224:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 76 00000100:00100000:0.0:1783967154.563238:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+12:2399:x1870624563809920:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:0.0:1783967154.563276:0:17097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606841f 00000020:00010000:0.0:1783967154.563295:0:17097:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a05c37c4800: total 0 00000100:00080000:0.0:1783967154.563300:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a10800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783967154.563336:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1783967154.563499:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47e19328-a632-4b1f-8ff8-755b3236cab4+11:2399:x1870624563809920:12345-192.168.204.59@tcp:39:umount.0 Request processed in 265us (645us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1783967154.563507:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 76 00000020:00010000:3.0:1783967154.563792:0:17084:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a05c37c4800: total 0 00010000:00010000:3.0:1783967154.563796:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967154.563851:0:17084:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a05c37c4800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1783967154.563888:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a04c3426000) 00010000:00010000:3.0:1783967154.563892:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783967154.563900:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602178a00/0x9269c8b31606874b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7187 expref: 10 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.563927:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05f1a82300) 00010000:00010000:3.0:1783967154.563929:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967154.563934:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d63000/0x9269c8b316068506 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70d8 expref: 9 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.563974:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:3.0:1783967154.563977:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967154.563982:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0200/0x9269c8b316068545 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70e6 expref: 8 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.563994:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967154.563996:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783967154.564000:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c7d62c00/0x9269c8b3160686f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7172 expref: 7 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.564013:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c3426600) 00010000:00010000:3.0:1783967154.564015:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967154.564019:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602179400/0x9269c8b3160684ea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70d1 expref: 6 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.564034:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a05f1a82200) 00010000:00010000:3.0:1783967154.564036:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783967154.564040:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0400/0x9269c8b3160685ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7110 expref: 5 pid: 17096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.564052:0:17084:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a05f1a82000) 00010000:00010000:3.0:1783967154.564054:0:17084:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783967154.564057:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b3160687b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71b1 expref: 4 pid: 17097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967154.564068:0:17084:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a05c37c4800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1783967154.564083:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967154.564090:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967154.564091:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967154.568028:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967154.574311:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967154.575911:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810048 00000100:00100000:1.0:1783967154.575925:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810048 00000100:00100000:1.0:1783967154.576069:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 77 00000100:00100000:1.0:1783967154.576083:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+5:2399:x1870624563810048:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:1.0:1783967154.576118:0:17095:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068426 00000100:00080000:1.0:1783967154.576138:0:17095:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783967154.576172:0:17095:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1783967154.576427:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47e19328-a632-4b1f-8ff8-755b3236cab4+3:2399:x1870624563810048:12345-192.168.204.59@tcp:39:umount.0 Request processed in 348us (2126us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783967154.576436:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 77 00010000:00010000:3.0:1783967154.576501:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783967154.576694:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1783967154.743083:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967154.946129:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967154.946181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967154.946227:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967154.946281:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810176 00000100:00100000:1.0:1783967154.946292:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810176 00000100:00100000:1.0:1783967154.946358:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:1.0:1783967154.946378:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+10:2403:x1870624563810176:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967154.947846:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+10:2403:x1870624563810176:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 1461us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967154.947861:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 176 00000100:00100000:2.0:1783967154.957441:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810304 00000100:00100000:2.0:1783967154.957456:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810304 00000100:00100000:3.0:1783967154.958812:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810432 00000100:00100000:3.0:1783967154.958833:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810432 00000100:00100000:3.0:1783967154.959707:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:3.0:1783967154.959721:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563810432:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967154.960059:0:17096:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783967154.960067:0:17096:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783967154.960147:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2403:x1870624563810432:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 428us (13916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967154.960155:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 102 00000100:00100000:3.0:1783967154.960175:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00100000:3.0:1783967154.960183:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2403:x1870624563810304:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967154.960212:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2403:x1870624563810304:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 31us (14103us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967154.960219:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 103 00000100:00080000:0.0:1783967154.966844:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967154.966865:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783967155.767114:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967156.087685:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588003840:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.087803:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967156.087868:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588004352:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.087893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967156.087910:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624588004864:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.087931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967156.087954:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1783967156.087960:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588003968:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.087998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967156.088029:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588004480:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088065:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588003712:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088105:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088130:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588004224:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088148:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088161:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588004736:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088178:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088188:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588005248:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088219:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783967156.088223:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588004096:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088238:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088245:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588004608:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088274:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624588005120:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088285:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088313:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004864 00000100:00100000:0.0:1783967156.088318:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004864 00000100:00100000:0.0:1783967156.088356:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004224 00000100:00100000:0.0:1783967156.088359:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004224 00000100:00100000:0.0:1783967156.088370:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004736 00000100:00100000:0.0:1783967156.088373:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004736 00000100:00100000:0.0:1783967156.088382:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005248 00000100:00100000:0.0:1783967156.088384:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005248 00000100:00100000:0.0:1783967156.088394:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005120 00000100:00100000:0.0:1783967156.088396:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005120 00000100:00100000:0.0:1783967156.088412:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783967156.088420:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624588004864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088470:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624588004864:12345-0@lo:400:kworker.0 Request processed in 50us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.088477:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783967156.088491:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783967156.088497:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588004224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088525:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588004224:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.088531:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783967156.088542:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783967156.088554:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588004736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088563:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c6bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588004992:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088585:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588004736:12345-0@lo:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.088592:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783967156.088605:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783967156.088611:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.088615:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588005248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088650:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624588004864:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088651:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588005248:12345-0@lo:400:kworker.0 Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.088664:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783967156.088678:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004992 00000100:00100000:0.0:1783967156.088681:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004992 00000100:00100000:3.0:1783967156.088691:0:17089:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003712 00000100:00100000:3.0:1783967156.088696:0:17089:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003712 00000100:00100000:0.0:1783967156.088707:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783967156.088716:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624588005120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088747:0:17089:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783967156.088757:0:17089:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624588003712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088760:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624588005120:12345-0@lo:400:kworker.0 Request processed in 44us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.088792:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783967156.088806:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783967156.088813:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624588004992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088820:0:17089:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624588003712:12345-0@lo:400:kworker.0 Request processed in 64us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967156.088828:0:17089:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783967156.088853:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624588004992:12345-0@lo:400:kworker.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.088859:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1783967156.088878:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c6bd7800 x1870624588004992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967156.088885:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003840 00000100:00100000:0.0:1783967156.088890:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003840 00000100:00100000:3.0:1783967156.088892:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588004992:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.088914:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004352 00000100:00100000:0.0:1783967156.088917:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004352 00000100:00080000:3.0:1783967156.088933:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967156.088938:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967156.088973:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624588005120:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088982:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588003712:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088990:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588004224:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.088998:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588004736:0@lo:400:kworker.0 00010000:00080000:3.0:1783967156.089007:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05fba45180 x1870624588005248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967156.089027:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588005248:0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.089149:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783967156.089159:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588003840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.089220:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588003840:12345-0@lo:400:kworker.0 Request processed in 63us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.089227:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783967156.089240:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783967156.089246:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588004352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967156.089272:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588004352:12345-0@lo:400:kworker.0 Request processed in 26us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.089278:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783967156.089395:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588003968 00000100:00100000:1.0:1783967156.089406:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588003968 00000100:00100000:1.0:1783967156.089437:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004480 00000100:00100000:1.0:1783967156.089440:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004480 00000100:00100000:1.0:1783967156.089451:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004096 00000100:00100000:1.0:1783967156.089453:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004096 00000100:00100000:1.0:1783967156.089464:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588004608 00000100:00100000:1.0:1783967156.089467:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588004608 00000100:00100000:1.0:1783967156.089480:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967156.089486:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967156.089520:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588003968:12345-0@lo:400:kworker.0 Request processed in 35us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967156.089526:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967156.089538:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783967156.089543:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588004480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967156.089569:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588004480:12345-0@lo:400:kworker.0 Request processed in 26us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967156.089576:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783967156.089585:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783967156.089591:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588004096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967156.089620:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588004096:12345-0@lo:400:kworker.0 Request processed in 29us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967156.089626:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783967156.089635:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783967156.089641:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588004608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967156.089664:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588004608:12345-0@lo:400:kworker.0 Request processed in 24us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967156.089670:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783967156.089875:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588005504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967156.089905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.089929:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967156.090014:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588005376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967156.090038:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967156.090064:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005504 00000100:00100000:0.0:1783967156.090068:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005504 00000100:00100000:0.0:1783967156.090092:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005376 00000100:00100000:0.0:1783967156.090094:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005376 00000100:00100000:0.0:1783967156.090105:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783967156.090112:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588005504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783967156.090133:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967156.090163:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588005504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.090169:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783967156.090179:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967156.090184:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588005376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783967156.090191:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967156.090217:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588005376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.090222:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967156.090249:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588005376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967156.090260:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588005504:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783967156.090307:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783967156.090311:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967156.090365:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588004096:0@lo:400:kworker.0 00000100:00100000:1.0:1783967156.090382:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588004608:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.090487:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588003968:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.090501:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588004480:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.090513:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588003840:0@lo:400:kworker.0 00000100:00100000:3.0:1783967156.090523:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c6bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588004352:0@lo:400:kworker.0 00000100:00100000:1.0:1783967156.093898:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588005632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967156.094081:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967156.094137:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005632 00000100:00100000:1.0:1783967156.094144:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005632 00000100:00100000:1.0:1783967156.094187:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967156.094196:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588005632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967156.094223:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1783967156.094262:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588005632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967156.094270:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967156.094316:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588005632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967156.451604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967156.451677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967156.451812:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810688 00000100:00100000:3.0:1783967156.451828:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810688 00000100:00100000:3.0:1783967156.451920:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810560 00000100:00100000:3.0:1783967156.451924:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810560 00000100:00100000:3.0:1783967156.451965:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1783967156.451977:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+11:2402:x1870624563810688:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967156.451998:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967156.452024:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0600/0x9269c8b316068450 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7084 expref: 11 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967156.452047:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967156.452196:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+10:2402:x1870624563810688:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 220us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967156.452206:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1783967156.452232:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1783967156.452239:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+9:2402:x1870624563810560:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967156.452247:0:19433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967156.452256:0:19433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df1000/0x9269c8b316068449 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7053 expref: 9 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967156.452283:0:19433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967156.452305:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419db461-1825-4e92-8b20-56544c55f6b4+8:2402:x1870624563810560:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 66us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967156.452312:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:1.0:1783967156.459306:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967156.461950:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563810816 00000100:00100000:0.0:1783967156.461971:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563810816 00000100:00100000:0.0:1783967156.462320:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:0.0:1783967156.462336:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419db461-1825-4e92-8b20-56544c55f6b4+8:2402:x1870624563810816:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967156.462360:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967156.462389:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c0030200/0x9269c8b31606848f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70c3 expref: 8 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967156.462412:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967156.462512:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419db461-1825-4e92-8b20-56544c55f6b4+7:2402:x1870624563810816:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 180us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.462521:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:3.0:1783967156.464256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967156.467314:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811072 00000100:00100000:0.0:1783967156.467339:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811072 00000100:00100000:0.0:1783967156.467477:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 78 00000100:00100000:0.0:1783967156.467490:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+6:2399:x1870624563811072:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:0.0:1783967156.467551:0:17097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606845e 00000020:00010000:0.0:1783967156.467560:0:17097:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a05fd855000: total 0 00000100:00080000:0.0:1783967156.467585:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a05fd853000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783967156.467627:0:17097:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00010000:2.0:1783967156.467647:0:17850:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a05fd855000: total 0 00010000:00010000:2.0:1783967156.467740:0:17850:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a05fd855000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783967156.467805:0:17850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ed1b6c00) 00010000:00010000:2.0:1783967156.467809:0:17850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783967156.467819:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316068553 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d70ed expref: 5 pid: 17095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967156.467849:0:17850:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a05fd855000, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1783967156.467851:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3b09368e-3456-41d0-9fd9-218c92aa494a+4:2399:x1870624563811072:12345-192.168.204.59@tcp:39:umount.0 Request processed in 363us (3608us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1783967156.467860:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 78 00010000:00010000:2.0:1783967156.467863:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967156.467865:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967156.467867:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967156.470347:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967156.476746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967156.476925:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811200 00000100:00100000:0.0:1783967156.476939:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811200 00000100:00100000:0.0:1783967156.477037:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 79 00000100:00100000:0.0:1783967156.477062:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+5:2399:x1870624563811200:12345-192.168.204.59@tcp:39:umount.0 00000020:00000080:0.0:1783967156.477121:0:17096:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068465 00000100:00080000:0.0:1783967156.477133:0:17096:0:(import.c:65:import_set_state_nolock()) ffff9a05fd857000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783967156.477160:0:17096:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1783967156.477359:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3b09368e-3456-41d0-9fd9-218c92aa494a+3:2399:x1870624563811200:12345-192.168.204.59@tcp:39:umount.0 Request processed in 309us (637us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783967156.477370:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 79 00010000:00010000:3.0:1783967156.477752:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967156.477947:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1783967156.544263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967156.544359:0:17091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811456 00000100:00100000:0.0:1783967156.544373:0:17091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811456 00000100:00100000:0.0:1783967156.544454:0:17091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 178 00000100:00100000:0.0:1783967156.544467:0:17091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+7:2399:x1870624563811456:12345-192.168.204.59@tcp:251:umount.0 00000020:00000080:0.0:1783967156.544527:0:17091:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160683fc 00000020:00010000:0.0:1783967156.544537:0:17091:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a05fd857800: total 0 00000100:00080000:0.0:1783967156.544543:0:17091:0:(import.c:65:import_set_state_nolock()) ffff9a05fd853800 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1783967156.544610:0:17084:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a05fd857800: total 0 00010000:00010000:3.0:1783967156.544704:0:17084:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a05fd857800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783967156.544755:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602178e00/0x9269c8b316068403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d6fdc expref: 3 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967156.544808:0:17084:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a05fd857800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783967156.544822:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967156.544825:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967156.544827:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967156.544878:0:17091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419db461-1825-4e92-8b20-56544c55f6b4+1:2399:x1870624563811456:12345-192.168.204.59@tcp:251:umount.0 Request processed in 412us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967156.544889:0:17091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 178 00000020:00000080:0.0:1783967156.544913:0:17091:0:(genops.c:906:class_export_put()) final put ffff9a05fd857800/419db461-1825-4e92-8b20-56544c55f6b4 00000020:00000080:3.0:1783967156.547138:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fd857800/419db461-1825-4e92-8b20-56544c55f6b4 for MGS 00000020:00000080:3.0:1783967156.547221:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05fd853800 for MGS 00000100:00100000:2.0:1783967156.599109:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967156.599215:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783967156.599244:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588005888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967156.599353:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967156.599444:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005888 00000100:00100000:3.0:1783967156.599454:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005888 00000100:00100000:3.0:1783967156.599528:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783967156.599540:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588005888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783967156.599610:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783967156.599684:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588005888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967156.599694:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783967156.599766:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588005888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967156.605125:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588005760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967156.605249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967156.605491:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588005760 00000100:00100000:3.0:1783967156.605502:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588005760 00000100:00100000:3.0:1783967156.605663:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783967156.605675:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588005760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783967156.605740:0:17100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1783967156.606007:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588005760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 332us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967156.606016:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783967156.606488:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588005760:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783967156.791013:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967157.495717:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783967157.815305:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783967158.453940:0:20668:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000040:00080000:1.0:1783967158.461083:0:17131:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783967158.461091:0:17131:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783967158.461136:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783967158.461143:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000020:01000004:0.0:1783967158.466070:0:20668:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783967158.466123:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.466138:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.466145:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.466151:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.466172:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783967158.466178:0:20668:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783967158.466200:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967158.466204:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783967158.466209:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783967158.466232:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1783967158.466290:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967158.466297:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.466304:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967158.466307:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.466315:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967158.466322:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967158.466327:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967158.466342:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783967158.466345:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783967158.466370:0:17084:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.466376:0:17084:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783967158.466418:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1783967158.466457:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.466465:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1c00/0x9269c8b316067fbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067fc6 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.466477:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967158.466479:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967158.466480:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967158.466523:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624588006016:0@lo:39:umount.0 00000100:00100000:2.0:1783967158.466592:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967158.466689:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006016 00000100:00100000:0.0:1783967158.466696:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006016 00000100:00100000:0.0:1783967158.466744:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783967158.466752:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870624588006016:12345-0@lo:39:umount.0 00000020:00000080:0.0:1783967158.466799:0:17097:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067ff0 00000100:00080000:0.0:1783967158.466806:0:17097:0:(import.c:65:import_set_state_nolock()) ffff9a04c44fb800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783967158.466862:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1870624588006016:12345-0@lo:39:umount.0 Request processed in 110us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967158.466869:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:0.0:1783967158.466876:0:17097:0:(genops.c:906:class_export_put()) final put ffff9a04c35ce000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1783967158.466960:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783967158.466970:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c35ce000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783967158.467017:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c44fb800 for lustre-MDT0000 00000100:00080000:2.0:1783967158.467116:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783967158.467125:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624588006016:0@lo:39:umount.0 00000100:00080000:0.0:1783967158.467205:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967158.467215:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783967158.467219:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1783967158.467360:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588006144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967158.467399:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967158.467561:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006144 00000100:00100000:3.0:1783967158.467700:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006144 00000100:00100000:3.0:1783967158.467748:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783967158.467757:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d866e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+24:3645:x1870624588006144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967158.467805:0:17083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967158.467825:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631600/0x9269c8b316067fc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316067fbf expref: 24 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.467842:0:17083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967158.467891:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d866e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3b28c549-2862-472c-a00b-4682deda9da4+23:3645:x1870624588006144:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967158.467898:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783967158.468183:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468193:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468200:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468206:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967158.468260:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588006144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967158.468329:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967158.468337:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468342:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468348:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468353:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468379:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967158.468385:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468401:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967158.468405:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468412:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967158.468418:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967158.468423:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967158.468426:0:17085:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1783967158.468446:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468453:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783967158.468501:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1783967158.468551:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468559:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d1400/0x9269c8b316067f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067f17 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468570:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967158.468573:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468579:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0a00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967158.468581:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468598:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967158.468604:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967158.468609:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967158.468611:0:17085:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1783967158.468623:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.468629:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783967158.468664:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1783967158.468669:0:20668:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1783967158.468677:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468701:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468708:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468714:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468732:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967158.468738:0:20668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468744:0:20668:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967158.468745:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588006400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967158.468751:0:20668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468756:0:20668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967158.468762:0:20668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783967158.468765:0:20668:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783967158.468790:0:20668:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1783967158.468802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1783967158.468820:0:20668:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783967158.468825:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783967158.468829:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1783967158.468833:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588006272:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1783967158.468834:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1783967158.468844:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a04c2497800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:2.0:1783967158.468851:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1783967158.468851:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a05c9def000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783967158.468855:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a05fcf75000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783967158.468860:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a05c8336800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783967158.468867:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a05fd855000 3b09368e-3456-41d0-9fd9-218c92aa494a 192.168.204.59@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1783967158.468873:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a05c37c4800 47e19328-a632-4b1f-8ff8-755b3236cab4 192.168.204.59@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:0.0:1783967158.468878:0:20668:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a05f4f73380) has exports, disconnecting them 00000020:00080000:0.0:1783967158.468882:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a04c2497800), last request at 1783967156 00000020:00000080:0.0:1783967158.468888:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160682eb 00000100:00080000:0.0:1783967158.468903:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a04c2493800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783967158.468948:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c2497800): rc 0 00000020:00000080:0.0:1783967158.468951:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c2497800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783967158.468962:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a05c9def000), last request at 1783967156 00000020:00000080:0.0:1783967158.468966:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606818d 00000100:00080000:0.0:1783967158.468970:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a05c9de8800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783967158.468980:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c2497800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1783967158.469010:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783967158.469015:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469022:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179c00 already unused, calling callback (ffffffffc150bc20) 00000020:00000080:0.0:1783967158.469023:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c2493800 for lustre-MDT0000 10000000:00010000:2.0:1783967158.469025:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469032:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783967158.469035:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05c9def000): rc 0 00000020:00000080:0.0:1783967158.469037:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05c9def000/lustre-MDT0000-lwp-OST0000_UUID 10000000:00010000:2.0:1783967158.469039:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783967158.469043:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a05fcf75000), last request at 1783967074 10000000:01000000:2.0:1783967158.469045:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:0.0:1783967158.469046:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160680de 10000000:01000000:2.0:1783967158.469047:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783967158.469049:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:0.0:1783967158.469050:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf72000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1783967158.469056:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c9def000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1783967158.469063:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469068:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1783967158.469078:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05c9de8800 for lustre-MDT0000 00010000:00010000:2.0:1783967158.469083:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783967158.469088:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05fcf75000): rc 0 00010000:00010000:2.0:1783967158.469089:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160684c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160684ce expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783967158.469095:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05fcf75000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1783967158.469102:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a05c8336800), last request at 1783967074 00010000:00010000:2.0:1783967158.469103:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000080:0.0:1783967158.469105:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068083 00010000:00010000:2.0:1783967158.469106:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783967158.469109:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a05c9dea800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783967158.469112:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967158.469115:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1783967158.469117:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcf75000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1783967158.469122:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967158.469127:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967158.469132:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783967158.469134:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783967158.469136:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:0.0:1783967158.469137:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05fcf72000 for lustre-MDT0000 00000001:00000004:0.0:1783967158.469146:0:20668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00010000:00010000:2.0:1783967158.469148:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469153:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783967158.469158:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469164:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0600/0x9269c8b316067f02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316067f09 expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469172:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967158.469174:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967158.469180:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967158.469194:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006400 00000100:00100000:2.0:1783967158.469199:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006400 00000020:00080000:0.0:1783967158.469215:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05c8336800): rc 0 00000004:00000080:0.0:1783967158.469220:0:20668:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb71ec82f3ae0 00000100:00100000:2.0:1783967158.469233:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006272 00000100:00100000:2.0:1783967158.469236:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006272 00000100:00080000:0.0:1783967158.469237:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783967158.469241:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1783967158.469253:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967158.469259:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+24:3648:x1870624588006400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967158.469270:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967158.469283:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b31606831c expref: 24 pid: 17091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469293:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967158.469323:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+23:3648:x1870624588006400:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967158.469330:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967158.469344:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967158.469348:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+22:3648:x1870624588006272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967158.469354:0:17082:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967158.469362:0:17082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631a00/0x9269c8b316067f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316067f10 expref: 22 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967158.469370:0:17082:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967158.469387:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3b28c549-2862-472c-a00b-4682deda9da4+21:3648:x1870624588006272:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967158.469393:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967158.469409:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588006656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967158.469431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967158.469446:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967158.469457:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588006528:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783967158.470079:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783967158.470095:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783967158.470225:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006656 00000100:00100000:1.0:1783967158.470236:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006656 00000100:00100000:1.0:1783967158.470295:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967158.470303:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+21:3646:x1870624588006656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967158.470312:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967158.470325:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630400/0x9269c8b316067f09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316067f02 expref: 21 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967158.470338:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967158.470371:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+20:3646:x1870624588006656:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967158.470379:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1783967158.470405:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967158.470531:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.470540:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0a00/0x9269c8b31606831c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068323 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.470553:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967158.470554:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967158.470557:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783967158.470746:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783967158.470750:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1783967158.470886:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783967158.470943:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783967158.470957:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783967158.470965:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783967158.470967:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1783967158.471016:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783967158.471073:0:20668:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783967158.471082:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783967158.471119:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a05f4f73380) has no exports 00000100:00100000:2.0:1783967158.471194:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967158.471244:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588006656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967158.471272:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588006784:0@lo:39:umount.0 00000100:00100000:2.0:1783967158.471298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967158.471316:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588006912:0@lo:9:umount.0 00000100:00100000:2.0:1783967158.471336:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967158.471352:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588007040:0@lo:9:umount.0 00000100:00100000:2.0:1783967158.471369:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967158.471398:0:17101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006784 00000100:00100000:2.0:1783967158.471403:0:17101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006784 00000100:00100000:2.0:1783967158.471433:0:17101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783967158.471439:0:17101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1870624588006784:12345-0@lo:39:umount.0 00000100:00100000:3.0:1783967158.471583:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006528 00000100:00100000:3.0:1783967158.471587:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006528 00000100:00100000:3.0:1783967158.471618:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783967158.471624:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+20:3646:x1870624588006528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967158.471634:0:17081:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967158.471649:0:17081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63e00/0x9269c8b3160684ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160684c7 expref: 20 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967158.471673:0:17081:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967158.471716:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3b28c549-2862-472c-a00b-4682deda9da4+19:3646:x1870624588006528:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967158.471724:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783967158.471753:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588006528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967158.472007:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588006912 00000100:00100000:1.0:1783967158.472011:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588006912 00000100:00100000:1.0:1783967158.472046:0:19333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007040 00000100:00100000:1.0:1783967158.472049:0:19333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007040 00000100:00100000:1.0:1783967158.472067:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783967158.472075:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1870624588006912:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783967158.472090:0:19333:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160681d3 00000100:00080000:1.0:1783967158.472097:0:19333:0:(import.c:65:import_set_state_nolock()) ffff9a04c3f05800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783967158.472131:0:19333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1783967158.472240:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1870624588006912:12345-0@lo:9:umount.0 Request processed in 166us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967158.472247:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783967158.472260:0:19333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967158.472266:0:19333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1870624588007040:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783967158.472277:0:19333:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606832a 00000100:00080000:1.0:1783967158.472282:0:19333:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f2d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783967158.472309:0:19333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1783967158.472387:0:19333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1870624588007040:12345-0@lo:9:umount.0 Request processed in 121us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967158.472394:0:19333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1783967158.472419:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967158.472424:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967158.472443:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1ac5000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783967158.472452:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783967158.472454:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783967158.472457:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588006912:0@lo:9:umount.0 00000100:00080000:1.0:1783967158.472467:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed1cb800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783967158.472473:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783967158.472475:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783967158.472478:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588007040:0@lo:9:umount.0 00000100:00080000:3.0:1783967158.472574:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783967158.472578:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1783967158.472643:0:17101:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068108 00000100:00080000:2.0:1783967158.472649:0:17101:0:(import.c:65:import_set_state_nolock()) ffff9a05f4e7e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783967158.472672:0:17101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:3.0:1783967158.472677:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967158.472797:0:17101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1870624588006784:12345-0@lo:39:umount.0 Request processed in 1357us (1497us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1783967158.472805:0:17101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783967158.472835:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588006400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967158.472845:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588006272:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783967158.472972:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c32fe800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783967158.472978:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588006784:0@lo:39:umount.0 00000020:00080000:0.0:1783967158.478265:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a05f4f73380) has no exports 00000020:00000080:0.0:1783967158.544092:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f5d 00000020:00000080:0.0:1783967158.544109:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c32f8800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783967158.544164:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783967158.544252:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32f8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1783967158.544280:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967158.544295:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783967158.544300:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a05c346b380) has no exports 00000020:00000080:2.0:1783967158.544543:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f56 00000020:00000080:2.0:1783967158.544549:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05f1a14800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783967158.544611:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967158.544619:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1783967158.544621:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05f1a16800/lustre-QMT0000_UUID 00000020:00000080:2.0:1783967158.544637:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a16800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1783967158.544645:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783967158.545016:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a14800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1783967158.838949:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967159.864092:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783967160.697860:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1783967160.697870:0:17076:0:(genops.c:906:class_export_put()) final put ffff9a05c8336800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1783967160.697892:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00080000:2.0:1783967160.697900:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1783967160.697904:0:17076:0:(genops.c:906:class_export_put()) final put ffff9a05fd855000/3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00100000:2.0:1783967160.697909:0:17076:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000001:00080000:2.0:1783967160.697925:0:17076:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1783967160.697927:0:17076:0:(genops.c:906:class_export_put()) final put ffff9a05c37c4800/47e19328-a632-4b1f-8ff8-755b3236cab4 00000001:00100000:0.0:1783967160.698169:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967160.698186:0:18598:0:(genops.c:906:class_export_put()) final put ffff9a04c3f03800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1783967160.698196:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000020:00000080:0.0:1783967160.698198:0:18598:0:(genops.c:906:class_export_put()) final put ffff9a05e77e0000/47e19328-a632-4b1f-8ff8-755b3236cab4 00000020:00000080:3.0:1783967160.698403:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c8336800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1783967160.698465:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fd855000/3b09368e-3456-41d0-9fd9-218c92aa494a for lustre-MDT0000 00000020:00000080:3.0:1783967160.698497:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c37c4800/47e19328-a632-4b1f-8ff8-755b3236cab4 for lustre-MDT0000 00000020:00000080:3.0:1783967160.698526:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3f03800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783967160.698545:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05e77e0000/47e19328-a632-4b1f-8ff8-755b3236cab4 for lustre-OST0000 00000020:00000080:3.0:1783967160.698560:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05c9dea800 for lustre-MDT0000 00000020:00000080:3.0:1783967160.698564:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05fd853000 for lustre-MDT0000 00000020:00000080:3.0:1783967160.698568:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f1a10800 for lustre-MDT0000 00000020:00000080:3.0:1783967160.698571:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3f05800 for lustre-OST0000 00000020:00000080:3.0:1783967160.698575:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05e77e5000 for lustre-OST0000 00000001:00100000:1.0:1783967160.701515:0:17829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783967160.701539:0:17829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1783967160.701544:0:17829:0:(genops.c:906:class_export_put()) final put ffff9a05ee18a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1783967160.701565:0:17829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00080000:1.0:1783967160.701569:0:17829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1783967160.701571:0:17829:0:(genops.c:906:class_export_put()) final put ffff9a05fd851800/3b09368e-3456-41d0-9fd9-218c92aa494a 00000001:00100000:1.0:1783967160.701576:0:17829:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 47e19328-a632-4b1f-8ff8-755b3236cab4 00000001:00080000:1.0:1783967160.701580:0:17829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1783967160.701582:0:17829:0:(genops.c:906:class_export_put()) final put ffff9a05f1a12800/47e19328-a632-4b1f-8ff8-755b3236cab4 00000020:00000080:0.0:1783967160.701664:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1783967160.701720:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fd851800/3b09368e-3456-41d0-9fd9-218c92aa494a for lustre-MDT0001 00000020:00000080:0.0:1783967160.701747:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a12800/47e19328-a632-4b1f-8ff8-755b3236cab4 for lustre-MDT0001 00000020:00000080:0.0:1783967160.701793:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4e7e000 for lustre-MDT0001 00000020:00000080:0.0:1783967160.701799:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05fd857000 for lustre-MDT0001 00000020:00000080:0.0:1783967160.701802:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05e77e3800 for lustre-MDT0001 00010000:00010000:3.0:1783967160.888702:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967161.207055:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c36b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588007168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967161.207127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967161.207179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967161.207186:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588007296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967161.207208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967161.207313:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007168 00000100:00100000:2.0:1783967161.207324:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007168 00000100:00100000:2.0:1783967161.207386:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007296 00000100:00100000:2.0:1783967161.207389:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007296 00000100:00100000:2.0:1783967161.207406:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783967161.207415:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588007168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967161.207452:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00002000:00000024:2.0:1783967161.207455:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967161.207478:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588007296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967161.207500:0:20236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967161.207511:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588007168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967161.207519:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783967161.207540:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588007296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967161.207548:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783967161.207810:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588007808:0@lo:400:kworker.0 00000100:00080000:0.0:1783967161.207854:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967161.207856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783967161.207860:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783967161.207879:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007808 00000100:00100000:3.0:1783967161.207883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783967161.207884:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007808 00000100:00100000:3.0:1783967161.207893:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588007680:0@lo:400:kworker.0 00000100:00100000:3.0:1783967161.207918:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967161.207922:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783967161.207929:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1870624588007808:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783967161.207936:0:17096:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783967161.207942:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588008192:0@lo:400:kworker.0 00000100:00100000:3.0:1783967161.207972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967161.207980:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1870624588007808:12345-0@lo:400:kworker.0 Request processed in 49us (123us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783967161.207987:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1783967161.208000:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007680 00000100:00100000:0.0:1783967161.208003:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007680 00000100:00080000:3.0:1783967161.208004:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783967161.208010:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783967161.208014:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1783967161.208015:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008192 00000100:00100000:0.0:1783967161.208019:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008192 00000100:00100000:0.0:1783967161.208052:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783967161.208058:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588008192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967161.208089:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588008192:12345-0@lo:400:kworker.0 Request processed in 31us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967161.208095:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783967161.208108:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783967161.208112:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1870624588007680:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783967161.208116:0:17096:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783967161.208138:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1870624588007680:12345-0@lo:400:kworker.0 Request processed in 24us (220us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783967161.208143:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1783967161.208161:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967161.208186:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588007296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967161.208201:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c36b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588007168:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967161.208388:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588007552:0@lo:400:kworker.0 00000100:00100000:2.0:1783967161.208397:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588007424:0@lo:400:kworker.0 00000100:00100000:1.0:1783967161.208438:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967161.208455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967161.208470:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624588008064:0@lo:400:kworker.0 00000100:00100000:2.0:1783967161.208497:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588007936:0@lo:400:kworker.0 00000100:00100000:1.0:1783967161.208497:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967161.208533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967161.208536:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008064 00000100:00100000:1.0:1783967161.208542:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008064 00000100:00100000:1.0:1783967161.208566:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007936 00000100:00100000:1.0:1783967161.208569:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007936 00000100:00100000:2.0:1783967161.208577:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783967161.208584:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1870624588008064:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1783967161.208590:0:17095:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1783967161.208599:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783967161.208608:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624588007936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967161.208658:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1870624588008064:12345-0@lo:400:kworker.0 Request processed in 72us (160us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783967161.208666:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624588007936:12345-0@lo:400:kworker.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967161.208669:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783967161.208678:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:1.0:1783967161.208710:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05e77eb100 x1870624588007936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967161.208721:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588007936:0@lo:400:kworker.0 00000100:00080000:1.0:1783967161.208751:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783967161.208755:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783967161.208758:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783967161.208763:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967161.208789:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1783967161.208796:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c3485000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967161.208817:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f11500 x1870624588008320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967161.208836:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624588008064:0@lo:400:kworker.0 00000100:00100000:1.0:1783967161.208854:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588008320:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783967161.208878:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967161.208906:0:17095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008320 00000100:00100000:2.0:1783967161.208912:0:17095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008320 00000100:00100000:1.0:1783967161.208926:0:17090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007424 00000100:00100000:1.0:1783967161.208931:0:17090:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007424 00000100:00100000:2.0:1783967161.208939:0:17095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783967161.208946:0:17095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588008320:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1783967161.208960:0:17095:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783967161.208969:0:17090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783967161.209036:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588007552 00000100:00100000:0.0:1783967161.209041:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588007552 00000100:00100000:0.0:1783967161.209067:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783967161.209072:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c36b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1870624588007552:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1783967161.209077:0:17100:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1783967161.209108:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c36b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1870624588007552:12345-0@lo:400:kworker.0 Request processed in 35us (670us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783967161.209114:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1783967161.209134:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967161.209151:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783967161.209154:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1783967161.209157:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1783967161.209168:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967161.209171:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1783967161.209176:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a05f4cb1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967161.209189:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba11c00 x1870624588008448/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967161.209205:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588007552:0@lo:400:kworker.0 00000100:00100000:0.0:1783967161.209225:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588008448:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1783967161.209455:0:17090:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fd226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+19:3645:x1870624588007424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967161.209499:0:17090:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fd226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3b28c549-2862-472c-a00b-4682deda9da4+19:3645:x1870624588007424:12345-0@lo:400:kworker.0 Request processed in 523us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967161.209506:0:17090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783967161.209543:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588007424:0@lo:400:kworker.0 00000100:00100000:0.0:1783967161.210460:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967161.210587:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008448 00000100:00100000:1.0:1783967161.210592:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008448 00000100:00100000:1.0:1783967161.210624:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783967161.210640:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588008448:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1783967161.210653:0:17100:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1783967161.210689:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588008448:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (232us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783967161.210696:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1783967161.213159:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967161.213173:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967161.213178:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588008448:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1783967161.234104:0:17095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588008320:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 25150us (25217us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967161.234120:0:17095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1783967161.237902:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967161.237914:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967161.237919:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588008320:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1783967161.245073:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967161.245087:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 568 00000100:00080000:3.0:1783967161.245099:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a05c37c1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967161.245144:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77e9880 x1870624588008576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967161.245241:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588008576:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783967161.245324:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967161.245516:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008576 00000100:00100000:1.0:1783967161.245524:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008576 00000100:00100000:1.0:1783967161.246445:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783967161.246454:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624588008576:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1783967161.246473:0:20582:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783967161.246643:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588007808:0@lo:400:kworker.0 00000100:00080000:3.0:1783967161.246687:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783967161.246691:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783967161.246695:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783967161.246699:0:3648:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967161.246703:0:3648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1783967161.246709:0:3648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a05fcf70800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967161.246731:0:3648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77eb480 x1870624588008704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967161.248587:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624588008704:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1783967161.248680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967161.248842:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624588008576:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 2384us (3513us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783967161.248852:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783967161.248879:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008704 00000100:00100000:1.0:1783967161.248887:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008704 00000100:00100000:3.0:1783967161.249842:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588007680:0@lo:400:kworker.0 00010000:00080000:3.0:1783967161.249876:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05e77e9180 x1870624588008192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967161.249903:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588008192:0@lo:400:kworker.0 00000100:00100000:2.0:1783967161.250144:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783967161.250153:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870624588008704:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1783967161.250171:0:17096:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1783967161.250237:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1870624588008704:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 83us (1556us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967161.250243:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1783967161.251003:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967161.251010:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967161.251014:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588008576:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1783967161.251050:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967161.251054:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967161.251071:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624588008704:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1783967161.910938:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967162.934990:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783967163.771541:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783967163.771675:0:19416:0:(genops.c:906:class_export_put()) final put ffff9a04c1f2b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967163.771760:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f2b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783967163.775029:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1f2d000 for lustre-OST0001 00010000:00010000:3.0:1783967163.960659:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783967164.598927:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1cff240 - data ffff9a05f80d2948/ffff9a05efbb9400 00000020:01000000:3.0:1783967164.599285:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05c7eb40c0 - data ffff9a05f80b8288/ffff9a05ef378800 00000001:00000004:3.0:1783967164.616356:0:20668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:2.0:1783967164.648942:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967164.648951:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783967164.648965:0:20668:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a05fba11180 x1870624588006784/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1783967168 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967164.648987:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1783967164.650231:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783967164.650237:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1783967164.650246:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783967164.650248:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783967164.650459:0:17119:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783967164.650464:0:17119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1783967164.650473:0:17119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1783967164.651175:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783967164.651180:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1783967164.651252:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783967164.651254:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783967164.651527:0:17121:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783967164.651531:0:17121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1783967164.651548:0:17121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1783967164.652858:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f25 00000020:00000080:2.0:1783967164.652870:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c3cc6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783967164.654067:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f3a 00000020:00000080:2.0:1783967164.654075:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c35ca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967164.654419:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3cc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783967164.654525:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783967164.654531:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.654539:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783967164.654543:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a05f4f719c0) has no exports 00000020:00000080:0.0:1783967164.654748:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c35ca800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1783967164.654844:0:20668:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783967164.654852:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f9c 00000020:00000080:2.0:1783967164.654857:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05f1a13800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783967164.654891:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783967164.654895:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.654899:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783967164.654902:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9a05c34c99c0) has no exports 00000020:00000080:2.0:1783967164.654908:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f95 00000020:00000080:2.0:1783967164.654912:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05ed1c9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783967164.654929:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a13800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783967164.655034:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed1c9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783967164.655428:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783967164.655433:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783967164.655437:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1783967164.655442:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783967164.655444:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783967164.655605:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.655611:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783967164.655622:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f87 00000020:00000080:2.0:1783967164.655626:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05ed1c8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967164.655663:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ed1cb800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1783967164.655668:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05ed1ca800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967164.655671:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed1ca800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1783967164.655677:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783967164.655881:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783967164.655885:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.655890:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783967164.655892:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a05c346cd40) has no exports 00000020:00000080:2.0:1783967164.655908:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f80 00000020:00000080:2.0:1783967164.655911:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783967164.655928:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed1c8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1783967164.658686:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783967164.658695:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783967164.658699:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1783967164.658706:0:20668:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783967164.658709:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783967164.658914:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783967164.659040:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.659052:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1783967164.659076:0:20668:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1783967164.659083:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f72 00000020:00000080:2.0:1783967164.659090:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783967164.659095:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1783967164.659104:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.659108:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783967164.659112:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9a04c1fdb380) has no exports 00000020:00000080:2.0:1783967164.659118:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f6b 00000020:00000080:2.0:1783967164.659121:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c32fe000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783967164.659307:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f1ac5000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1783967164.659314:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05f1ac7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967164.659316:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1783967164.659322:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783967164.659397:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1ac6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783967164.659401:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32fe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1783967164.667896:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1783967164.667908:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967164.667952:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783967164.667960:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783967164.668037:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.668049:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783967164.668078:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.668081:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783967164.668086:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c3cc4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783967164.668091:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3cc4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783967164.668103:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783967164.668236:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f41 00000020:00000080:2.0:1783967164.668243:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c35cf000/lustre-MDD0000_UUID 00000020:00000080:0.0:1783967164.668306:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c32fe800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1783967164.668313:0:36:0:(genops.c:906:class_export_put()) final put ffff9a04c32fc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783967164.668315:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c32fc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1783967164.668319:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783967164.668414:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783967164.668426:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.668431:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783967164.668435:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a05f4f74d40) has no exports 00000020:00000080:2.0:1783967164.668464:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.668467:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783967164.668470:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067f48 00000020:00000080:2.0:1783967164.668474:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c35cc800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783967164.668561:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c35cf000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1783967164.668573:0:36:0:(genops.c:906:class_export_put()) final put ffff9a04c35cf800/lustre-MDD0000_UUID 00000020:00000080:0.0:1783967164.668575:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c35cf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1783967164.668583:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1783967164.668660:0:20668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05fcff7800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783967164.668663:0:20668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff7800 3 00000020:01000004:2.0:1783967164.668666:0:20668:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05fcff7800 from lustre-MDT0000 00000020:00000080:2.0:1783967164.668684:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.668688:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783967164.668690:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a04c3cc5000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783967164.668693:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3cc5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783967164.668700:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783967164.668732:0:20668:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1783967164.668736:0:20668:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783967164.668739:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783967164.668742:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.668744:0:20668:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783967164.668750:0:20668:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a04c44ff800 3b28c549-2862-472c-a00b-4682deda9da4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783967164.668755:0:20668:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a04c1fdcd40) has exports, disconnecting them 00000020:00080000:2.0:1783967164.668759:0:20668:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a04c44ff800), last request at 1783967056 00000020:00000080:2.0:1783967164.668805:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067ee6 00000020:00010000:2.0:1783967164.668809:0:20668:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a04c44ff800: total 1 00000100:00080000:2.0:1783967164.668813:0:20668:0:(import.c:65:import_set_state_nolock()) ffff9a04c44fb000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783967164.668825:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c44ff800): rc 0 00000020:00080000:2.0:1783967164.668828:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a04c1fdcd40) has no exports 00000020:00010000:1.0:1783967164.668897:0:17850:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a04c44ff800: total 1 00010000:00010000:1.0:1783967164.668901:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967164.668936:0:17850:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a04c44ff800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783967164.668967:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df1400/0x9269c8b3160682d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160682cf expref: 14 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.668982:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df1800/0x9269c8b316067efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316067ef4 expref: 13 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.668993:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068315 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b31606830e expref: 12 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669005:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5630e00/0x9269c8b31606800c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316068005 expref: 11 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669031:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274e600/0x9269c8b316068178 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316068171 expref: 10 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669042:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05c7d63200/0x9269c8b3160684a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b31606849d expref: 9 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669051:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274f000/0x9269c8b3160680c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160680c2 expref: 8 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669062:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0000/0x9269c8b31606801a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316068013 expref: 7 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669073:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0a00/0x9269c8b316068028 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316068021 expref: 6 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669082:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602179e00/0x9269c8b3160684c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160684b9 expref: 5 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669093:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0c00/0x9269c8b3160684b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160684ab expref: 4 pid: 17090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669104:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a04c274fe00/0x9269c8b31606814e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b316068147 expref: 3 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669113:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1000/0x9269c8b3160682ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9269c8b3160682a5 expref: 2 pid: 17089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967164.669122:0:17850:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a04c44ff800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1783967164.669135:0:17850:0:(genops.c:906:class_export_put()) final put ffff9a04c44ff800/3b28c549-2862-472c-a00b-4682deda9da4 00000020:00000080:0.0:1783967164.669201:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c35cc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1783967164.669241:0:17091:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a05f4e6bc00:17091] 2 exiting: rc = 0 00010000:00010000:1.0:1783967164.669545:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967164.669553:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967164.669555:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967164.669592:0:17090:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a05f4ec4c00:17090] 1 exiting: rc = 0 00000100:00100000:1.0:1783967164.669656:0:17089:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a05f4ec4200:17089] 0 exiting: rc = 1 00000100:00100000:2.0:1783967164.669733:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669741:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669750:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669758:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669865:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669873:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669879:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669886:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669892:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669898:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669904:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669910:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669915:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669920:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669925:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669930:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669936:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669941:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669947:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669952:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669956:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669961:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669966:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669971:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669976:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669980:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669986:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669991:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.669996:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670001:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670006:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670010:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670015:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670021:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670025:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670030:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670036:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670041:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670045:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670059:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670064:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670070:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670076:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670081:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670086:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670090:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670095:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670101:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670106:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670112:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670118:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670122:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670128:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670133:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670138:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670144:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670150:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670155:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670165:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670171:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670176:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670181:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670187:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967164.670192:0:20668:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783967164.670960:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c44ff800/3b28c549-2862-472c-a00b-4682deda9da4 for MGS 00000020:00000080:0.0:1783967164.671004:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c44fb000 for MGS 00000020:01000000:2.0:1783967164.671521:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1f24c60 - data ffff9a05f8029d80/ffff9a05ef9b1800 00000020:01000000:2.0:1783967164.671658:0:20668:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a05c9d9d0c0 - data ffff9a05f816fca8/ffff9a04c3edec00 00000020:00000080:2.0:1783967164.672187:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067ed1 00000020:00000080:2.0:1783967164.672195:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05fcff6000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783967164.672302:0:20668:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05fcff7800 from MGS, refs=2 00000020:01000004:2.0:1783967164.672307:0:20668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff7800 2 00000020:01000004:2.0:1783967164.672310:0:20668:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05fcff7800 from MGS 00000020:00000080:2.0:1783967164.672330:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.672335:0:20668:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783967164.672347:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05fcff7000/MGS 00000020:00000080:2.0:1783967164.672349:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcff7000/MGS for MGS 00000020:01000000:2.0:1783967164.672356:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783967164.672422:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783967164.672425:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.672431:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783967164.672438:0:20668:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a05e03de000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783967164.672443:0:20668:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9a04c347b380) has exports, disconnecting them 00000020:00080000:2.0:1783967164.672518:0:20668:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a05e03de000), last request at 1783967056 00000020:00000080:2.0:1783967164.672523:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067fd4 00000020:00080000:2.0:1783967164.672533:0:20668:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05e03de000): rc 0 00000020:00000080:2.0:1783967164.672537:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05e03de000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783967164.672561:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcff6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783967164.673427:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05e03de000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783967164.706310:0:20668:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783967164.706320:0:20668:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967164.706324:0:20668:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783967164.706331:0:20668:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783967164.706606:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.706615:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783967164.706636:0:20668:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05fcff7800 1 00000020:00000080:2.0:1783967164.706643:0:20668:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067ec3 00000020:00000080:2.0:1783967164.706651:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05fcff5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783967164.707070:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1f6c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783967164.707078:0:8:0:(genops.c:906:class_export_put()) final put ffff9a04c1f68000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783967164.707081:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f68000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783967164.707093:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1783967164.707342:0:20668:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783967164.707349:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967164.707356:0:20668:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783967164.707361:0:20668:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a04c1fd99c0) has no exports 00000020:00000080:0.0:1783967164.711128:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcff5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783967164.774122:0:20668:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967164.774135:0:20668:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783967164.774141:0:20668:0:(genops.c:906:class_export_put()) final put ffff9a05fcff6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783967164.774146:0:20668:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcff6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783967164.774157:0:20668:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783967164.774273:0:20668:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05fcff0000 00000020:02000400:2.0:1783967164.774348:0:20668:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783967164.991374:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967166.007170:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967166.330832:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967166.330858:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588008832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967166.330930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967166.331007:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008832 00000100:00100000:0.0:1783967166.331016:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008832 00000100:00100000:0.0:1783967166.331074:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783967166.331083:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588008832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1783967166.331112:0:18606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967166.331156:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588008832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967166.331164:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1783967166.331185:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783967166.331220:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588008832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967166.331993:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588008960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967166.332045:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967166.332170:0:20236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588008960 00000100:00100000:2.0:1783967166.332177:0:20236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588008960 00000100:00100000:2.0:1783967166.332220:0:20236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783967166.332229:0:20236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588008960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783967166.332250:0:20236:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967166.332291:0:20236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588008960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967166.332299:0:20236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1783967166.332352:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967166.332380:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588008960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967166.335524:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588009088:0@lo:400:kworker.0 00000400:00000100:2.0:1783967166.335591:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624588009088 offset 0 length 224: 4 00000100:00080000:0.0:1783967166.335667:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967166.335671:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967166.335676:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967166.335681:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1783967166.335685:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783967166.337211:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a05f4cb1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967166.337257:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba12680 x1870624588009216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967166.337291:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967166.337296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967166.337299:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967166.337303:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1783967166.337307:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783967166.337311:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a05fcf70800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967166.337335:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba12300 x1870624588009344/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967166.337344:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967166.337348:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967166.337349:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967166.337352:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1783967166.337354:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783967166.337372:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a05c37c1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967166.337383:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba10700 x1870624588009472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967166.337413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967166.337417:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967166.337419:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967166.337422:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 637 00000100:00080000:0.0:1783967166.337425:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783967166.337428:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c3485000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967166.337439:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba10380 x1870624588009728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967166.337476:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588009856:0@lo:400:kworker.0 00000100:00100000:0.0:1783967166.337565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967166.337609:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967166.337615:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624588009600:0@lo:400:kworker.0 00000100:00100000:0.0:1783967166.337641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967166.337677:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009856 00000100:00100000:0.0:1783967166.337687:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009856 00000100:00100000:3.0:1783967166.337843:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588009216:0@lo:38:kworker.0 00000100:00100000:3.0:1783967166.337879:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967166.337903:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624588009344:0@lo:38:kworker.0 00000100:00100000:3.0:1783967166.337923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967166.337939:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588009472:0@lo:38:kworker.0 00000100:00100000:3.0:1783967166.337958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967166.337974:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588009728:0@lo:38:kworker.0 00000100:00100000:3.0:1783967166.337995:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967166.338017:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009600 00000100:00100000:3.0:1783967166.338020:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009600 00000100:00100000:3.0:1783967166.338071:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009344 00000100:00100000:3.0:1783967166.338073:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009344 00000100:00100000:3.0:1783967166.338081:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009472 00000100:00100000:3.0:1783967166.338090:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009472 00000100:00100000:3.0:1783967166.338101:0:20582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009728 00000100:00100000:3.0:1783967166.338104:0:20582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009728 00000100:00100000:3.0:1783967166.338116:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783967166.338125:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624588009600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967166.338182:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624588009600:12345-0@lo:400:kworker.0 Request processed in 58us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967166.338189:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783967166.338207:0:20582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783967166.338211:0:20582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624588009344:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783967166.338230:0:20582:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967166.338893:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783967166.338899:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588009856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967166.338939:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588009856:12345-0@lo:400:kworker.0 Request processed in 40us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967166.338945:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783967166.338959:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783967166.338963:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624588009472:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783967166.338985:0:17097:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967166.339022:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624588009472:12345-0@lo:38:kworker.0 Request processed in 57us (1062us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967166.339028:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783967166.339042:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783967166.339045:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624588009728:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783967166.339055:0:17097:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967166.339077:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624588009728:12345-0@lo:38:kworker.0 Request processed in 30us (1082us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967166.339082:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1783967166.339129:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967166.339134:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967166.339138:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588009472:0@lo:38:kworker.0 00000100:00080000:0.0:1783967166.339147:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967166.339151:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967166.339154:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588009728:0@lo:38:kworker.0 00000100:00080000:0.0:1783967166.339184:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1783967166.339205:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a05fba13480 x1870624588009600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967166.339216:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624588009600:0@lo:400:kworker.0 00010000:00080000:0.0:1783967166.339226:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a05fba13100 x1870624588009856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967166.339235:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588009856:0@lo:400:kworker.0 00000100:00100000:0.0:1783967166.339291:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009216 00000100:00100000:0.0:1783967166.339297:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009216 00000100:00100000:0.0:1783967166.339316:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783967166.339320:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588009216:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1783967166.340530:0:17100:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967166.340659:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588009216:12345-0@lo:38:kworker.0 Request processed in 1336us (2777us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967166.340669:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1783967166.345922:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967166.345940:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967166.345945:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588009216:0@lo:38:kworker.0 00000100:00100000:3.0:1783967166.364179:0:20582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1870624588009344:12345-0@lo:38:kworker.0 Request processed in 25953us (26241us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783967166.364196:0:20582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1783967166.366296:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967166.366313:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967166.366319:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624588009344:0@lo:38:kworker.0 00010000:00010000:2.0:1783967167.032646:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967167.743271:0:17849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783967168.054943:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783967168.662083:0:20871:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783967168.676210:0:20871:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1783967168.676266:0:20871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.676280:0:20871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.676286:0:20871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.676292:0:20871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.676317:0:20871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783967168.676322:0:20871:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783967168.676363:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967168.676367:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783967168.676373:0:20871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783967168.676379:0:20871:0:(import.c:65:import_set_state_nolock()) ffff9a05fcf70800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1783967168.676383:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967168.676384:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783967168.676387:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783967168.677028:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967168.677036:0:17085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967168.677046:0:17085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967168.677050:0:17085:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967168.677060:0:17085:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967168.677067:0:17085:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967168.677085:0:17085:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967168.677087:0:17085:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783967168.677090:0:17085:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783967168.677135:0:17085:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967168.677142:0:17085:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967168.677171:0:17085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967168.677179:0:17085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274f400/0x9269c8b3160680c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160680c9 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967168.677193:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967168.677194:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967168.677196:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967168.677215:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588009984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967168.677288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967168.677363:0:17083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588009984 00000100:00100000:3.0:1783967168.677370:0:17083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588009984 00000100:00100000:3.0:1783967168.677409:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783967168.677417:0:17083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1870624588009984:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783967168.677423:0:17083:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783967168 with bad export cookie 10550184273586323174 00010000:00010000:1.0:1783967168.685277:0:20871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685294:0:20871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685302:0:20871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685311:0:20871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685333:0:20871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967168.685339:0:20871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685345:0:20871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685365:0:20871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685372:0:20871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685387:0:20871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783967168.685394:0:20871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685400:0:20871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685406:0:20871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685412:0:20871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685423:0:20871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783967168.685428:0:20871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685434:0:20871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685440:0:20871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685456:0:20871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967168.685463:0:20871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1783967168.685466:0:20871:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:1.0:1783967168.685509:0:20871:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:1.0:1783967168.685514:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:1.0:1783967168.685518:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783967168.685523:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783967168.685531:0:20871:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9a04c1f2e800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783967168.685538:0:20871:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9a05f1a10000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783967168.685543:0:20871:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9a05f55f19c0) has exports, disconnecting them 00000020:00080000:1.0:1783967168.685547:0:20871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a04c1f2e800), last request at 1783967166 00000020:00000080:1.0:1783967168.685554:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068300 00000100:00080000:1.0:1783967168.685570:0:20871:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f28000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783967168.685607:0:20871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c1f2e800): rc 0 00000020:00000080:1.0:1783967168.685610:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a04c1f2e800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:1.0:1783967168.685621:0:20871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a05f1a10000), last request at 1783967166 00000020:00000080:1.0:1783967168.685624:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160681a2 00000100:00080000:1.0:1783967168.685630:0:20871:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a54000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783967168.685641:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f2e800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1783967168.685694:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1f28000 for lustre-MDT0001 00000020:00080000:1.0:1783967168.685706:0:20871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05f1a10000): rc 0 00000020:00000080:1.0:1783967168.685709:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f1a10000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:1.0:1783967168.685719:0:20871:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb71ec1d8fae0 00000020:00000080:1.0:1783967168.685729:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a10000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1783967168.685748:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f1a54000 for lustre-MDT0001 00000100:00080000:1.0:1783967168.685797:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783967168.685800:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1783967168.686459:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783967168.686467:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686477:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274e400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967168.686481:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686502:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967168.686511:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967168.686517:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783967168.686519:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1783967168.686522:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1783967168.686557:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686564:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783967168.686588:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686609:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274e400/0x9269c8b316068021 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068028 expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783967168.686618:0:20871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1783967168.686620:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00080000:1.0:1783967168.686623:0:20871:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1783967168.686624:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686643:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967168.686646:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686653:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967168.686659:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967168.686664:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783967168.686666:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783967168.686668:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783967168.686682:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.686687:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783967168.686703:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.688572:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0e00/0x9269c8b31606830e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b316068315 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.688617:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783967168.688623:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.688630:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967168.688634:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.688642:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967168.688649:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967168.688655:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783967168.688657:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783967168.688660:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783967168.688692:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.688698:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783967168.689665:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967168.689692:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588010240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967168.690325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967168.690934:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967168.690949:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588010112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967168.691087:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691101:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1e00/0x9269c8b3160684b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b3160684c0 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691118:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967168.691123:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691145:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274ec00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967168.691150:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691159:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967168.691166:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967168.691172:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783967168.691174:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783967168.691177:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783967168.691213:0:17850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691219:0:17850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783967168.691240:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691247:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274ec00/0x9269c8b316068013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9269c8b31606801a expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967168.691261:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967168.691263:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967168.691265:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967168.691271:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783967168.691279:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624588010368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967168.691309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967168.693237:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783967168.693259:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588010496:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1783967168.693400:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783967168.693404:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1783967168.693418:0:20871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783967168.693477:0:20871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783967168.693511:0:20871:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783967168.693528:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783967168.693531:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1783967168.693540:0:20871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783967168.693608:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588010624:0@lo:9:umount.0 00000100:00100000:1.0:1783967168.693639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967168.693673:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588010624 00000100:00100000:1.0:1783967168.693680:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588010624 00000100:00100000:1.0:1783967168.693736:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783967168.693747:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1870624588010624:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783967168.693793:0:18603:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160681cc 00000100:00080000:1.0:1783967168.693805:0:18603:0:(import.c:65:import_set_state_nolock()) ffff9a04c3f02000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783967168.693847:0:18603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1783967168.693993:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1870624588010624:12345-0@lo:9:umount.0 Request processed in 247us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967168.694017:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1783967168.694059:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ee18b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783967168.694064:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783967168.694066:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783967168.694069:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588010624:0@lo:9:umount.0 00000100:00080000:1.0:1783967168.694088:0:20871:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783967168.694097:0:20871:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783967168.694114:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588010752:0@lo:9:umount.0 00000100:00100000:1.0:1783967168.694139:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967168.694165:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588010752 00000100:00100000:1.0:1783967168.694169:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588010752 00000100:00100000:1.0:1783967168.694198:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783967168.694205:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1870624588010752:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783967168.694219:0:18604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068331 00000100:00080000:1.0:1783967168.694225:0:18604:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f2a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783967168.694248:0:18604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1783967168.694330:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3644:x1870624588010752:12345-0@lo:9:umount.0 Request processed in 125us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967168.694336:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1783967168.694359:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cb0000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783967168.694363:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783967168.694365:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783967168.694368:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588010752:0@lo:9:umount.0 00000020:00080000:1.0:1783967168.694415:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9a05f55f19c0) has no exports 00010000:00010000:1.0:1783967168.694448:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967168.694455:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967168.694479:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783967168.694501:0:17092:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967168.694531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967168.697594:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588010240 00000100:00100000:2.0:1783967168.697613:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588010240 00000100:00100000:2.0:1783967168.697672:0:17082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588010368 00000100:00100000:2.0:1783967168.697676:0:17082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588010368 00000100:00100000:2.0:1783967168.697692:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783967168.697700:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1870624588010240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783967168.700198:0:17082:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783967168 with bad export cookie 10550184273586323174 00000100:00100000:2.0:1783967168.700313:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1870624588010240:12345-0@lo:103:ldlm_bl.0 Request processed in 2611us (9987us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783967168.700324:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783967168.700358:0:17082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967168.700365:0:17082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1870624588010368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783967168.700369:0:17082:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783967168 with bad export cookie 10550184273586323174 00000100:00100000:2.0:1783967168.700399:0:17082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1870624588010368:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (9089us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783967168.700404:0:17082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967168.700431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967168.700477:0:19433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588010496 00000100:00100000:2.0:1783967168.700485:0:19433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588010496 00000100:00100000:2.0:1783967168.700524:0:19433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967168.700528:0:19433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1870624588010496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1783967168.700532:0:19433:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783967168 with bad export cookie 10550184273586323174 00000100:00100000:2.0:1783967168.700564:0:19433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1870624588010496:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (132us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783967168.700569:0:19433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783967168.700602:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783967168.700606:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783967168.700609:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.159@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1783967168.705416:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783967168.705679:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783967168.709614:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.159@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783967168.724340:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.159@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783967168.724347:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783967168.724358:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05fba11180 x1870624588009088/t0(0) o400->MGC192.168.204.159@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783967182 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967168.724371:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05e77e8a80 x1870624588009984/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967184 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967168.724404:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05fba47100 x1870624588010240/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967184 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967168.724415:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05fba47480 x1870624588010112/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967184 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967168.724435:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05fba44380 x1870624588010368/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967184 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967168.724445:0:3646:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05fba46d80 x1870624588010496/t0(0) o103->MGC192.168.204.159@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783967184 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783967168.724454:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783967168.724471:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783967168.724473:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783967168.725332:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a05ed193800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1783967168.725385:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3b28c549-2862-472c-a00b-4682deda9da4:3647:1870624588010368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967168.725655:0:17081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588010112 00000100:00100000:0.0:1783967168.725664:0:17081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588010112 00000100:00100000:0.0:1783967168.725760:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783967168.725812:0:17081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d866f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1870624588010112:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783967168.725820:0:17081:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783967168 with bad export cookie 10550184273586323174 00000100:00100000:0.0:1783967168.725949:0:17081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d866f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3645:x1870624588010112:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (31416us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783967168.725968:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783967168.726208:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a05ed193800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1783967168.726241:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3b28c549-2862-472c-a00b-4682deda9da4:3648:1870624588010240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967168.727278:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588010112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967168.727566:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3b28c549-2862-472c-a00b-4682deda9da4:3645:1870624588009984:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1783967168.728178:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967168.728186:0:3646:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 532 00000100:00080000:2.0:1783967168.728196:0:3646:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05ed193800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967168.728232:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba46300 x1870624588010880/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783967168.728266:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b28c549-2862-472c-a00b-4682deda9da4:3644:1870624588010880:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1783967168.728307:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624588010880 offset 0 length 520: 4 00000100:00100000:2.0:1783967168.728358:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588009088:0@lo:400:kworker.0 00000100:00100000:2.0:1783967168.728373:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3b28c549-2862-472c-a00b-4682deda9da4:3646:1870624588010496:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1783967168.734951:0:17083:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1870624588009984 offset 224 length 224: 4 00000100:00100000:2.0:1783967168.734982:0:17083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3645:x1870624588009984:12345-0@lo:103:ldlm_bl.0 Request processed in 57563us (57693us total) trans 0 rc -107/-107 00000100:00100000:2.0:1783967168.735110:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00080000:1.0:1783967168.742061:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9a05f55f19c0) has no exports 00000020:01000000:2.0:1783967168.791836:0:20871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1cff7e0 - data ffff9a05f8172948/ffff9a05efbbac00 00000020:01000000:2.0:1783967168.791984:0:20871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1f82660 - data ffff9a05f82920d8/ffff9a05c4b14400 00000001:00000004:2.0:1783967168.801032:0:20871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1783967168.862551:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783967168.862561:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1783967168.862569:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1783967168.865038:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783967168.865048:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1783967168.865064:0:20871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783967168.865067:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783967168.865671:0:17837:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783967168.865677:0:17837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1783967168.865688:0:17837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1783967168.866521:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783967168.866526:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1783967168.866559:0:20871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783967168.866562:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783967168.867031:0:17839:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783967168.867036:0:17839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1783967168.867045:0:17839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1783967168.871187:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068036 00000020:00000080:0.0:1783967168.871198:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f570e000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1783967168.872075:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606804b 00000020:00000080:0.0:1783967168.872082:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f5708800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1783967168.872089:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1783967168.872094:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967168.872103:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783967168.872107:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a05f55f4d40) has no exports 00000004:01000000:0.0:1783967168.872268:0:20871:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783967168.872277:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606809f 00000020:00000080:0.0:1783967168.872281:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb7800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1783967168.872285:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1783967168.872288:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967168.872293:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783967168.872295:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9a05ea2399c0) has no exports 00000020:00000080:0.0:1783967168.872300:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068098 00000020:00000080:0.0:1783967168.872303:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb6800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783967168.872464:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f570e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783967168.872472:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5708800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1783967168.872476:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783967168.872480:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb6800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1783967168.876182:0:20871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1783967168.876191:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783967168.876195:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1783967168.876203:0:20871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783967168.876205:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783967168.876294:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967168.876321:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783967168.876329:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606808a 00000020:00000080:0.0:1783967168.876339:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4cf2000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783967168.877036:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4cb0000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1783967168.877045:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05f4cf5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783967168.877048:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cf5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1783967168.877055:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1783967168.877203:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1783967168.877209:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967168.877217:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783967168.877221:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9a05f4f70000) has no exports 00000020:00000080:0.0:1783967168.877229:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606807c 00000020:00000080:0.0:1783967168.877234:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05ee18a000/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1783967168.877659:0:20871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1783967168.877664:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783967168.877667:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1783967168.877671:0:20871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783967168.877673:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783967168.877700:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967168.877705:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1783967168.877719:0:20871:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1783967168.877725:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606806e 00000020:00000080:0.0:1783967168.877729:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05c9dee000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1783967168.877734:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1783967168.877738:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967168.877741:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783967168.877744:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a04c347cd40) has no exports 00000020:00000080:0.0:1783967168.877747:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068067 00000020:00000080:0.0:1783967168.877751:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb0800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783967168.881332:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cf2000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783967168.881358:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ee18a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783967168.881376:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ee18b000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1783967168.881386:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05c9def800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783967168.881390:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c9def800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1783967168.881395:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1783967168.881501:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c9dee000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1783967168.881507:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1783967168.915118:0:20871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1783967168.915127:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967168.915131:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783967168.915139:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783967168.915235:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4cb1800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1783967168.915292:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967168.915304:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783967168.915309:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783967168.915324:0:20871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1783967168.915332:0:20871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783967168.915508:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967168.915512:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783967168.915515:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4ebf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783967168.915517:0:20871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4ebf000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1783967168.915521:0:20871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1783967168.915605:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068052 00000020:00000080:0.0:1783967168.915612:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f570a800/lustre-MDD0001_UUID 00000020:01000000:0.0:1783967168.915664:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1783967168.915669:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967168.915674:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783967168.915677:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a05f55f0000) has no exports 00000020:00000080:0.0:1783967168.915695:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967168.915699:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1783967168.915703:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068059 00000020:00000080:0.0:1783967168.915706:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f570b000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783967168.916198:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f570a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1783967168.916204:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05f5708000/lustre-MDD0001_UUID 00000020:00000080:3.0:1783967168.916206:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5708000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1783967168.916215:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1783967168.916535:0:20871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05c2f6c000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1783967168.916540:0:20871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05c2f6c000 2 00000020:01000004:0.0:1783967168.916544:0:20871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05c2f6c000 from lustre-MDT0001 00000020:00000080:0.0:1783967168.916564:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967168.916569:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1783967168.916571:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f5709000/lustre-MDT0001_UUID 00000020:00000080:0.0:1783967168.916574:0:20871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5709000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1783967168.916580:0:20871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1783967168.916610:0:20871:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1783967168.916613:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1783967168.916617:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967168.916620:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783967168.916627:0:20871:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a05fcf73000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783967168.916632:0:20871:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9a05f55f3380) has exports, disconnecting them 00000020:00080000:0.0:1783967168.916646:0:20871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a05fcf73000), last request at 1783967074 00000020:00000080:0.0:1783967168.916651:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160680d7 00000020:00080000:0.0:1783967168.916662:0:20871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a05fcf73000): rc 0 00000020:00000080:0.0:1783967168.916666:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05fcf73000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783967168.916937:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f570b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783967168.916944:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05fcf73000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1783967168.934726:0:20871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1783967168.934735:0:20871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967168.934740:0:20871:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783967168.934747:0:20871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783967168.935159:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967168.935179:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1783967168.935186:0:20871:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05c2f6c000 1 00000020:00000080:1.0:1783967168.935192:0:20871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067ffe 00000020:00000080:1.0:1783967168.935201:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05f4cb5800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783967168.935291:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05fcf70800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1783967168.935300:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05f4ebe800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1783967168.935315:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4ebe800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1783967168.935320:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1783967168.936111:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1783967168.936117:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783967168.936124:0:20871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783967168.936128:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9a04c1fd8000) has no exports 00000020:00000080:3.0:1783967168.936469:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4cb5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1783967168.977730:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783967168.977746:0:20871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1783967168.977753:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05c2f6b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1783967168.977758:0:20871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05c2f6b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1783967168.977764:0:20871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1783967168.977936:0:20871:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05c2f6e000 00000020:01000000:3.0:1783967168.977957:0:20871:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783967168.977961:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783967168.977965:0:20871:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783967168.977969:0:20871:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a05c34699c0) has no exports 00000100:00100000:3.0:1783967168.978798:0:20582:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a05c6921200:20582] 3 exiting: rc = 0 00000100:00100000:0.0:1783967168.978801:0:17097:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a04c269dc00:17097] 2 exiting: rc = 0 00000100:00100000:2.0:1783967168.980631:0:17096:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a04c269d800:17096] 1 exiting: rc = 0 00000100:00100000:2.0:1783967168.980822:0:17095:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a04c269da00:17095] 0 exiting: rc = 1 00000100:00100000:3.0:1783967168.980939:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.980948:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.980955:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.980961:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.980966:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.980972:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.980977:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981071:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981081:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981087:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981092:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981098:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981104:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981112:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981118:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981123:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981130:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981136:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981141:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981363:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981433:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981441:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981447:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981453:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981459:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981464:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981470:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981474:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981480:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981498:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981505:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981510:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981516:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981523:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981529:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981535:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981541:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981546:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981551:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981556:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981561:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981566:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981569:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981573:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981577:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981581:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981585:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981589:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981593:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981599:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981652:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981659:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981665:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981670:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981687:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981693:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981699:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981704:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981709:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981714:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981719:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981727:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981734:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.981739:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967168.987835:0:17099:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a04c269c600:17099] 1 exiting: rc = 0 00000100:00100000:0.0:1783967168.988065:0:17098:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a04c269d400:17098] 0 exiting: rc = 1 00000100:00100000:1.0:1783967168.988231:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988240:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988246:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988253:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988259:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988264:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988269:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988275:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988280:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988286:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988291:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988296:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988301:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988307:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988327:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988333:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988340:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988346:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988351:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988357:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988361:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988490:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988499:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988504:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988509:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988513:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988518:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988523:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988528:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988533:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988539:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988544:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988550:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988556:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988561:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988567:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988573:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988578:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988584:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988594:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988599:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988613:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988618:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988623:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988627:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988631:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988635:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988640:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988644:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988656:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988660:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988665:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988670:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988674:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988679:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988683:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988687:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988691:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988695:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988699:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988703:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988708:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988713:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.988717:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967168.989936:0:17101:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a04c269ce00:17101] 1 exiting: rc = 0 00000100:00100000:2.0:1783967168.990258:0:17100:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a04c269c400:17100] 0 exiting: rc = 1 00000100:00100000:1.0:1783967168.990439:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990457:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990464:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990470:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990476:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990490:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990496:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990501:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990507:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990513:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990517:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990523:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990529:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990550:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990557:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990563:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990569:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990575:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990582:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990589:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990679:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990686:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990694:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990700:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990708:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990731:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990739:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990745:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990752:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990757:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990764:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990944:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990953:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990959:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990964:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990971:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.990976:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991006:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991013:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991019:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991025:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991031:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991037:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991042:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991048:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991053:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991059:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991065:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991071:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991201:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991209:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991214:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991219:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991224:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991229:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991243:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991249:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991257:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991263:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991269:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991275:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991280:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991286:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967168.991292:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967169.002798:0:17102:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a05f5541800:17102] 0 exiting: rc = 1 00000100:00100000:3.0:1783967169.003270:0:17103:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a05c9dd6e00:17103] 1 exiting: rc = 0 00000100:00100000:1.0:1783967169.003530:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003537:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003542:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003546:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003551:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003556:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003561:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003565:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003570:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003574:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003578:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003583:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003587:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003592:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003596:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003610:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003615:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003619:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003624:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003629:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003633:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003637:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003642:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003646:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003651:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003655:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003672:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003676:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003681:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003685:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003691:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003696:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003700:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003705:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003710:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003715:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003719:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003724:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003738:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003743:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003748:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003752:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003757:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003762:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003855:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003861:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003867:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003871:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003876:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003881:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003886:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003891:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003896:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003901:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003906:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003911:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003916:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003922:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003926:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003931:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003936:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003950:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003955:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.003960:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967169.004529:0:17104:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a05c3497200:17104] 0 exiting: rc = 1 00000100:00100000:3.0:1783967169.005179:0:17105:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a05c3496c00:17105] 1 exiting: rc = 0 00000100:00100000:1.0:1783967169.005305:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005311:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005316:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005320:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005325:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005329:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005333:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005337:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005342:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005347:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005352:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005356:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005360:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005377:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005383:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005388:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005392:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005396:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005401:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005406:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005411:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005416:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005421:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005427:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005432:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005437:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005442:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005446:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005451:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005455:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005460:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005464:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005479:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005495:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005501:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005505:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005510:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005515:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005520:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005526:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005530:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005535:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005539:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005544:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005549:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005554:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005560:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005564:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005569:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005574:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005579:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005583:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005588:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005592:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005597:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005601:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005606:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005610:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005614:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005630:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005635:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005640:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005645:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.005650:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783967169.006002:0:17106:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a05c3497400:17106] 0 exiting: rc = 1 00000100:00100000:3.0:1783967169.006071:0:17107:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a05c3496a00:17107] 1 exiting: rc = 0 00000100:00100000:1.0:1783967169.006283:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006289:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006293:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006309:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006314:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006319:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006323:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006328:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006333:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006337:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006342:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006347:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006351:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006356:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006361:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006377:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006382:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006388:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006393:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006398:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006402:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006406:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006411:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006415:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006419:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006424:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006428:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006433:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006437:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006442:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006446:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006451:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006456:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006461:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006466:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006471:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006476:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006480:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006519:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006523:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006529:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006534:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006539:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006545:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006549:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006554:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006559:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006564:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006568:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006573:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006578:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006583:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006588:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006593:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006598:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006602:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006607:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006612:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006617:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006622:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006626:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006631:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006636:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.006641:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967169.008060:0:17109:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a05d8b2ee00:17109] 1 exiting: rc = 0 00000100:00100000:2.0:1783967169.008504:0:17110:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a05d8b2f000:17110] 2 exiting: rc = 0 00000100:00100000:3.0:1783967169.009160:0:17108:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a05ee146000:17108] 0 exiting: rc = 1 00000100:00100000:1.0:1783967169.011658:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011670:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011676:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011683:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011688:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011695:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011700:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011705:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011710:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011842:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011848:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011852:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011858:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011863:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011869:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011875:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011880:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011885:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011890:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011894:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011899:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011904:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011910:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011915:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011935:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011942:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011947:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011954:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011960:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011965:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011970:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011976:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.011983:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012052:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012061:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012066:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012071:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012076:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012081:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012087:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012093:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012164:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012173:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012178:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012191:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012196:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012202:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012208:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012233:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012245:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012250:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012258:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012264:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012270:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012276:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012281:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012288:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012293:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012298:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012303:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012310:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012315:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012321:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967169.012326:0:20871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783967169.019712:0:20871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967169.019726:0:20871:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783967169.020710:0:20871:0:(genops.c:906:class_export_put()) final put ffff9a05ed190000/MDS_uuid 00000020:00000080:1.0:1783967169.020716:0:20871:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed190000/MDS_uuid for MDS 00000020:01000000:1.0:1783967169.020726:0:20871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783967169.021549:0:20871:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1783967169.086628:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967170.102926:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967171.131787:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783967171.446909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967171.446919:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967171.446923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967171.446927:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967171.446932:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967171.446940:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 642 00000100:00080000:0.0:1783967171.446947:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783967171.446955:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a05c37c1800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967171.447002:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee129f80 x1870624588011008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967171.447078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783967171.447082:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967171.447084:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967171.447103:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 642 00000100:00080000:0.0:1783967171.447106:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783967171.447110:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c3485000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967171.447123:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee12bb80 x1870624588011264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967171.447175:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624588011392:0@lo:400:kworker.0 00000400:00000100:0.0:1783967171.447229:0:3647:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011392 offset 0 length 224: 4 00000100:00100000:1.0:1783967171.447362:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967171.447373:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588011136:0@lo:400:kworker.0 00000400:00000100:1.0:1783967171.447398:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011136 offset 0 length 224: 4 00000100:00100000:2.0:1783967171.447726:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588011008:0@lo:38:kworker.0 00000400:00000100:2.0:1783967171.447752:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011008 offset 0 length 520: 4 00000100:00100000:2.0:1783967171.447813:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588011264:0@lo:38:kworker.0 00000400:00000100:2.0:1783967171.447831:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011264 offset 0 length 520: 4 00010000:00010000:3.0:1783967172.153370:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783967173.123238:0:21071:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783967173.143682:0:21071:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1783967173.143761:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967173.144216:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967173.144224:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967173.144253:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967173.144319:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783967173.144327:0:21071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783967173.144363:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967173.144379:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee129f80 x1870624588011008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967173.144413:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783967173.144421:0:21071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783967173.144428:0:21071:0:(import.c:65:import_set_state_nolock()) ffff9a05c37c1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1783967173.144434:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783967173.144439:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee129f80 x1870624588011008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967191 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967173.144447:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783967173.144450:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1783967173.145566:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588011008:0@lo:38:kworker.0 00000100:00080000:2.0:1783967173.146657:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967173.146672:0:21071:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee128700 x1870624588011136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967187 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967173.146693:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1783967173.146698:0:21071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1783967173.146726:0:21071:0:(import.c:65:import_set_state_nolock()) ffff9a05f4ebd000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1783967173.147014:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624588011520:0@lo:39:umount.0 00000100:00100000:3.0:1783967173.147176:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588011136:0@lo:400:kworker.0 00000400:00000100:0.0:1783967173.147254:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011520 offset 0 length 224: 4 00010000:00010000:1.0:1783967173.150965:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967173.150986:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967173.151031:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274f600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967173.151036:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967173.151049:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967173.151057:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967173.151063:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783967173.151076:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783967173.151081:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783967173.151108:0:17084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:1.0:1783967173.151112:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967173.151121:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274f600/0x9269c8b316068171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316068178 expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967173.151264:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967173.151267:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967173.151269:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967173.175073:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967173.495724:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967173.495739:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967173.495743:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967173.495746:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783967173.495974:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588011648:0@lo:400:kworker.0 00000400:00000100:0.0:1783967173.496054:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011648 offset 0 length 224: 4 00010000:00010000:3.0:1783967174.199083:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783967174.522633:0:19416:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1783967174.522650:0:19416:0:(genops.c:906:class_export_put()) final put ffff9a04c1f28800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1783967174.527235:0:18598:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1783967174.527249:0:18598:0:(genops.c:906:class_export_put()) final put ffff9a04c3f06000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1783967174.527341:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f28800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783967174.527432:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c1f2a800 for lustre-OST0001 00000020:00000080:3.0:1783967174.538020:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3f06000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1783967174.538142:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3f02000 for lustre-OST0000 00010000:00010000:3.0:1783967175.223335:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967176.247398:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783967176.503487:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967176.503501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967176.503505:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967176.503509:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967176.503643:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967176.503681:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624588011776:0@lo:400:kworker.0 00000400:00000100:2.0:1783967176.503796:0:3646:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588011776 offset 0 length 224: 4 00010000:00010000:2.0:1783967177.271254:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967178.294968:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967168/real 1783967168] req@ffff9a05fba46300 x1870624588010880/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783967178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967178.295025:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba46300 x1870624588010880/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783967178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783967178.295053:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967178.295085:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783967178.295091:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b28c549-2862-472c-a00b-4682deda9da4:3644:1870624588010880:0@lo:250:ptlrpcd_00_01.0 00010000:00010000:0.0:1783967178.295337:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967178.295390:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967178.295396:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783967178.295399:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967178.295405:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 644 00000100:00080000:3.0:1783967178.295411:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.159@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783967178.295419:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05ed193800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967178.295459:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77eaa00 x1870624588011904/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967178.295485:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783967178.295489:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783967178.295572:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b28c549-2862-472c-a00b-4682deda9da4:3644:1870624588011904:0@lo:250:kworker.0 00000400:00000100:0.0:1783967178.295630:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870624588011904 offset 0 length 520: 4 00000100:00100000:1.0:1783967178.295725:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967178.295741:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588012032:0@lo:400:kworker.0 00000400:00000100:1.0:1783967178.295784:0:3645:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588012032 offset 0 length 224: 4 00010000:00010000:3.0:1783967179.321822:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967180.350706:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967181.368172:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967182.391343:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967183.415085:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967183.416166:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967173/real 1783967173] req@ffff9a05fba45880 x1870624588011520/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967183 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967183.416224:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba45880 x1870624588011520/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967183 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783967183.416250:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4ebd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783967183.416274:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624588011520:0@lo:39:umount.0 00000100:00080000:2.0:1783967183.416548:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967183.416555:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783967183.416561:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783967183.418019:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418042:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418050:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418058:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418096:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967183.418106:0:21071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418114:0:21071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418120:0:21071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418126:0:21071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967183.418151:0:21071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783967183.418449:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967183.418460:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967183.418468:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967183.418473:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967183.418486:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967183.418495:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967183.418503:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783967183.418507:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1783967183.418528:0:17084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967183.418531:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967183.418541:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967183.418550:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967183.418553:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967183.418558:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967183.418563:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967183.418571:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0200/0x9269c8b316068147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b31606814e expref: -99 pid: 18597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967183.418575:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967183.418601:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967183.418604:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967183.418606:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783967183.418666:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783967183.418668:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783967183.418672:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783967183.418683:0:17850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967183.418687:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967183.418694:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b3160684ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160684b2 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967183.418711:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967183.418713:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967183.418715:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783967183.418815:0:21071:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1783967183.418822:0:21071:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1783967183.418866:0:21071:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1783967183.418872:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1783967183.418877:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967183.418885:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783967183.418891:0:21071:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9a04c34799c0) has no exports 00000020:00080000:2.0:1783967183.418929:0:21071:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9a04c34799c0) has no exports 00000020:01000000:2.0:1783967183.432303:0:21071:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1cff9c0 - data ffff9a05f81cd5e8/ffff9a05ef9b6800 00000020:01000000:2.0:1783967183.432524:0:21071:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1cff3c0 - data ffff9a05d98cc870/ffff9a04c357b000 00100000:10000000:2.0:1783967183.444893:0:21071:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783967183.450339:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606815c 00000020:00000080:2.0:1783967183.450370:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a04c375a000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783967183.450398:0:21071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05f571a000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783967183.450404:0:21071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f571a000 2 00000020:01000004:2.0:1783967183.450408:0:21071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a05f571a000 from lustre-OST0000 00000020:00000080:2.0:1783967183.450448:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967183.450460:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783967183.450465:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a05e03db800/lustre-OST0000_UUID 00000020:00000080:2.0:1783967183.450470:0:21071:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05e03db800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783967183.450478:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783967183.450557:0:21071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783967183.450563:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783967183.450567:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967183.450574:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783967183.450584:0:21071:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a04c3f01800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783967183.450591:0:21071:0:(genops.c:1574:class_disconnect_exports()) OBD device 23 (ffff9a05c34c8000) has exports, disconnecting them 00000020:00080000:2.0:1783967183.450596:0:21071:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a04c3f01800), last request at 1783967092 00000020:00000080:2.0:1783967183.450601:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068186 00000020:00080000:2.0:1783967183.450612:0:21071:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c3f01800): rc 0 00000020:00000080:2.0:1783967183.450627:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a04c3f01800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783967183.451473:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c375a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783967183.451497:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3f01800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783967183.453518:0:21071:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783967183.453533:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967183.453539:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783967183.453553:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783967183.453804:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783967183.453818:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1783967183.453838:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1783967183.453850:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967183.453854:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783967183.453863:0:21071:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a04c3f04800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783967183.453871:0:21071:0:(genops.c:1574:class_disconnect_exports()) OBD device 24 (ffff9a04c3144d40) has exports, disconnecting them 00000020:00080000:0.0:1783967183.453877:0:21071:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a04c3f04800), last request at 1783967092 00000020:00000080:0.0:1783967183.453882:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606819b 00000020:00080000:0.0:1783967183.453901:0:21071:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c3f04800): rc 0 00000020:00000080:0.0:1783967183.453908:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a04c3f04800/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783967183.454667:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05c37c1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1783967183.454681:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05f5519800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1783967183.454685:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5519800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1783967183.454692:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1783967183.454811:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3f04800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1783967183.454841:0:21071:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1783967183.454845:0:21071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1783967183.454849:0:21071:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783967183.454854:0:21071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783967183.454873:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05f4ebd000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1783967183.454999:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967183.455005:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1783967183.455007:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a05f551d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1783967183.455009:0:21071:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f551d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1783967183.455015:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1783967183.455036:0:21071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f571a000 1 00000020:00000080:1.0:1783967183.455041:0:21071:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316068139 00000020:00000080:1.0:1783967183.455046:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a05f4e7d000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1783967183.455053:0:21071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1783967183.455058:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4e7d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1783967183.455063:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783967183.455066:0:21071:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783967183.455069:0:21071:0:(genops.c:1579:class_disconnect_exports()) OBD device 20 (ffff9a05ea23b380) has no exports 00000020:00000080:1.0:1783967183.548894:0:21071:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967183.548928:0:21071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1783967183.548935:0:21071:0:(genops.c:906:class_export_put()) final put ffff9a05f571b800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1783967183.548942:0:21071:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f571b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1783967183.548961:0:21071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1783967183.549111:0:21071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05f5718800 00000020:02000400:1.0:1783967183.549178:0:21071:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1783967183.735660:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967183.735670:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967183.735673:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967183.735693:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967183.736023:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967183.736048:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588012160:0@lo:400:kworker.0 00000400:00000100:3.0:1783967183.736139:0:3648:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588012160 offset 0 length 224: 4 00010000:00010000:2.0:1783967184.440706:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967185.463068:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967186.487056:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967187.518048:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783967187.831169:0:3647:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967171/real 1783967171] req@ffff9a05ee12ad80 x1870624588011392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967187.867640:0:3647:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9a05ee12ad80 x1870624588011392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783967187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783967187.867655:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9a04c2490800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783967187.867659:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783967187.891815:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1783967187.891905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1783967187.893235:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624588011392:0@lo:400:kworker.0 00000100:00080000:1.0:1783967187.894039:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3b28c549-2862-472c-a00b-4682deda9da4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967187.894043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967187.894046:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967187.894049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783967187.894052:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783967187.894056:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c2490800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967187.894067:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1783967187.894076:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a04c2490800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967187.894184:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee12b480 x1870624588012288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967187.894419:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624588012288:0@lo:38:kworker.0 00000400:00000100:1.0:1783967187.894473:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870624588012288 offset 0 length 520: 4 00000020:01000004:0.0:1783967188.014872:0:21275:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783967188.045040:0:21275:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783967188.045149:0:21275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.045165:0:21275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.045172:0:21275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.045180:0:21275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.045211:0:21275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783967188.045217:0:21275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783967188.045240:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967188.045252:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee12bb80 x1870624588011264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.045272:0:21275:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783967188.045277:0:21275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783967188.045282:0:21275:0:(import.c:65:import_set_state_nolock()) ffff9a04c3485000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783967188.045286:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783967188.045290:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee12bb80 x1870624588011264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967191 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.045297:0:21275:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783967188.045299:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:3.0:1783967188.045424:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967188.045432:0:17084:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.045440:0:17084:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a04c274fa00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967188.045443:0:17084:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.045452:0:17084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967188.045481:0:17084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967188.045486:0:17084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967188.045489:0:17084:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783967188.045491:0:17084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783967188.045505:0:17084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967188.045509:0:17084:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.045515:0:17084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274fa00/0x9269c8b3160682cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160682d6 expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.045533:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967188.045535:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967188.045537:0:17084:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967188.046244:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588011264:0@lo:38:kworker.0 00000100:00080000:0.0:1783967188.051633:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783967188.051653:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05e77e9500 x1870624588011648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051679:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a04c1f12300 x1870624588011776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967192 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051723:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05e77ea300 x1870624588012032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051735:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a04c1f12a00 x1870624588012160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967199 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051743:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee12b480 x1870624588012288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967197 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051755:0:21275:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783967188.051762:0:21275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1783967188.051792:0:21275:0:(import.c:65:import_set_state_nolock()) ffff9a04c2490800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783967188.051798:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1783967188.051802:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05e77e9500 x1870624588011648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967189 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051808:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a04c1f12300 x1870624588011776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967192 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051814:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05e77ea300 x1870624588012032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967194 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051821:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a04c1f12a00 x1870624588012160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967199 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051827:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05ee12b480 x1870624588012288/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783967197 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967188.051834:0:21275:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783967188.051837:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1783967188.051960:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588012160:0@lo:400:kworker.0 00000100:00100000:3.0:1783967188.051983:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588011648:0@lo:400:kworker.0 00000100:00100000:1.0:1783967188.052341:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588012032:0@lo:400:kworker.0 00000100:00100000:1.0:1783967188.052371:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624588012288:0@lo:38:kworker.0 00000100:00100000:2.0:1783967188.052487:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1870624588011776:0@lo:400:kworker.0 00010000:00010000:0.0:1783967188.053878:0:21275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053896:0:21275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053918:0:21275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053925:0:21275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053945:0:21275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967188.053954:0:21275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053960:0:21275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053967:0:21275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053972:0:21275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967188.053991:0:21275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783967188.053996:0:21275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783967188.054020:0:21275:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783967188.054025:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783967188.054030:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783967188.054035:0:21275:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783967188.054039:0:21275:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9a04c3478000) has no exports 00000020:00080000:0.0:1783967188.054065:0:21275:0:(genops.c:1579:class_disconnect_exports()) OBD device 26 (ffff9a04c3478000) has no exports 00010000:00010000:3.0:1783967188.054884:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967188.054894:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.054903:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967188.054906:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.054915:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967188.054934:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967188.054940:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783967188.054943:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1783967188.054945:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1783967188.054960:0:17850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967188.054964:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.054971:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1200/0x9269c8b3160682a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160682ac expref: -99 pid: 19415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.054984:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967188.054987:0:17850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.054992:0:17850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c7d62400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967188.054994:0:17850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.055000:0:17850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967188.055005:0:17850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967188.055010:0:17850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783967188.055012:0:17850:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783967188.055020:0:17850:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783967188.055027:0:17850:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:3.0:1783967188.055030:0:17850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.055036:0:17850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c7d62400/0x9269c8b31606849d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b3160684a4 expref: -99 pid: 17093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967188.055048:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967188.055049:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967188.055051:0:17850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967188.055114:0:17085:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783967188.062243:0:21275:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c1cff120 - data ffff9a04c2047360/ffff9a05ef9b5000 00000020:01000000:0.0:1783967188.062424:0:21275:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a04c31e4ba0 - data ffff9a05d23e1510/ffff9a05efbbf400 00100000:10000000:0.0:1783967188.071419:0:21275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783967188.077664:0:21275:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160682ba 00000020:00000080:2.0:1783967188.077683:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a04c1f2c800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1783967188.078321:0:21275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a04c1f6f800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1783967188.078466:0:21275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c1f6f800 2 00000020:01000004:2.0:1783967188.078470:0:21275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a04c1f6f800 from lustre-OST0001 00000020:00000080:2.0:1783967188.078507:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967188.078522:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1783967188.078526:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a05f5680000/lustre-OST0001_UUID 00000020:00000080:2.0:1783967188.078531:0:21275:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f5680000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1783967188.078543:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1783967188.078701:0:21275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3b28c549-2862-472c-a00b-4682deda9da4->MGS 00010000:00010000:2.0:1783967188.078723:0:21275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967188.078739:0:21275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967188.078746:0:21275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1783967188.078750:0:21275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1783967188.078754:0:21275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1783967188.078802:0:21275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:2.0:1783967188.078807:0:21275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a04c274e000/0x9269c8b316068005 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b31606800c expref: -99 pid: 17828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967188.078826:0:21275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967188.078852:0:21275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967188.078857:0:21275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783967188.078860:0:21275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1783967188.078861:0:21275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1783967188.078873:0:21275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a05ed193800 00010000:00010000:2.0:1783967188.078875:0:21275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631e00/0x9269c8b316067ef4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9269c8b316067efb expref: -99 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783967188.078896:0:21275:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1783967188.078901:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783967188.078903:0:21275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783967188.078905:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783967188.078911:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783967188.078925:0:21275:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a05e77eaa00 x1870624588011904/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783967193 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783967188.078950:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783967188.078954:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:1.0:1783967188.079984:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c1f2c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1783967188.080049:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3b28c549-2862-472c-a00b-4682deda9da4:3644:1870624588011904:0@lo:250:kworker.0 10000000:01000000:2.0:1783967188.080179:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783967188.080200:0:21275:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b316067edf 00000020:00000080:2.0:1783967188.080211:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a05ed191000/3b28c549-2862-472c-a00b-4682deda9da4 00000020:01000000:2.0:1783967188.080235:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.159@tcp (flags='') 00000020:00000080:2.0:1783967188.080244:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967188.080262:0:21275:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.159@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783967188.080267:0:21275:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a05c3468000) has no exports 10000000:01000000:3.0:1783967188.080584:0:17093:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1783967188.080626:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed191000/3b28c549-2862-472c-a00b-4682deda9da4 for MGC192.168.204.159@tcp 10000000:01000000:2.0:1783967188.081133:0:21275:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.159@tcp: client import never connected 00000100:00080000:2.0:1783967188.081140:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1783967188.081145:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1783967188.081149:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1783967188.081172:0:21275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1783967188.081249:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783967188.081258:0:21275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.159@tcp (uuid 3b28c549-2862-472c-a00b-4682deda9da4) 00000020:01000000:2.0:1783967188.081266:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1783967188.081270:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783967188.081275:0:21275:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783967188.081282:0:21275:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a04c3480000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783967188.081289:0:21275:0:(genops.c:1574:class_disconnect_exports()) OBD device 27 (ffff9a05ea238000) has exports, disconnecting them 00000020:00080000:2.0:1783967188.081293:0:21275:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a04c3480000), last request at 1783967110 00000020:00000080:2.0:1783967188.081298:0:21275:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160682e4 00000020:00080000:2.0:1783967188.081323:0:21275:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c3480000): rc 0 00000020:00000080:2.0:1783967188.081328:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a04c3480000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783967188.084158:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a05ed193800 for MGC192.168.204.159@tcp 00000020:00000080:1.0:1783967188.084184:0:36:0:(genops.c:906:class_export_put()) final put ffff9a05ed197000/3b28c549-2862-472c-a00b-4682deda9da4 00000020:00000080:1.0:1783967188.084188:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05ed197000/3b28c549-2862-472c-a00b-4682deda9da4 for MGC192.168.204.159@tcp 00000020:01000000:1.0:1783967188.084200:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.159@tcp (3b28c549-2862-472c-a00b-4682deda9da4) 00000020:00000080:1.0:1783967188.084662:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3480000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1783967188.084673:0:21275:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1783967188.084687:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783967188.084693:0:21275:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783967188.084700:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783967188.084933:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783967188.084943:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1783967188.084950:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783967188.084955:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783967188.084959:0:21275:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783967188.084967:0:21275:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a04c2492800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783967188.084974:0:21275:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9a04c249cd40) has exports, disconnecting them 00000020:00080000:3.0:1783967188.084978:0:21275:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a04c2492800), last request at 1783967110 00000020:00000080:3.0:1783967188.084982:0:21275:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b3160682f9 00000020:00080000:3.0:1783967188.085000:0:21275:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a04c2492800): rc 0 00000020:00000080:3.0:1783967188.085006:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a04c2492800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1783967188.085495:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c3485000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783967188.085509:0:36:0:(genops.c:906:class_export_put()) final put ffff9a04c3486000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783967188.085512:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c3486000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783967188.085520:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783967188.085586:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c2492800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1783967188.117760:0:21275:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783967188.117836:0:21275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1783967188.117840:0:21275:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783967188.117848:0:21275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783967188.117981:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a04c2490800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1783967188.118841:0:17084:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783967188.119047:0:17850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783967188.119268:0:17085:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1783967188.119416:0:17080:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a05cf06b000:17080] 1 exiting: rc = 0 00000100:00100000:2.0:1783967188.119512:0:17079:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a04c1fd1a00:17079] 0 exiting: rc = 1 00000100:00100000:1.0:1783967188.119607:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.119943:0:17081:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a05f1a6e600:17081] 0 exiting: rc = 1 00000100:00100000:2.0:1783967188.120012:0:17083:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a05cf06ac00:17083] 2 exiting: rc = 0 00000100:00100000:2.0:1783967188.120851:0:19433:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a04c2605600:19433] 3 exiting: rc = 0 00000100:00100000:2.0:1783967188.124944:0:17082:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a05cf06be00:17082] 1 exiting: rc = 0 00000100:00100000:2.0:1783967188.129934:0:20123:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9a04c3ccc800:20123] 4 exiting: rc = 0 00000100:00100000:1.0:1783967188.134395:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134407:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134414:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134420:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134426:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134433:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134439:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134444:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134449:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134455:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134462:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134467:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134473:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134478:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134483:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134489:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134494:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134500:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134505:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134510:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134516:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134522:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134528:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134535:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134541:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134546:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134552:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134557:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134563:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134568:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134573:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134578:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134584:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134589:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134595:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134617:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134623:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134629:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134636:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134641:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134647:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134653:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134659:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134664:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134670:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134676:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134681:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134687:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134692:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134697:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134703:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134709:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134714:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134720:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134726:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134732:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134738:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134744:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134750:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134755:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.134761:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.136614:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.136645:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.136651:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783967188.140427:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783967188.140442:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1783967188.140447:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a04c2496800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1783967188.140452:0:21275:0:(genops.c:865:class_export_destroy()) destroying export ffff9a04c2496800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1783967188.140464:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1783967188.140545:0:21275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c1f6f800 1 00000020:00000080:1.0:1783967188.140552:0:21275:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x9269c8b31606829e 00000020:00000080:1.0:1783967188.140559:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a05f4eb8800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783967188.140578:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783967188.140582:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783967188.140588:0:21275:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783967188.140591:0:21275:0:(genops.c:1579:class_disconnect_exports()) OBD device 25 (ffff9a05ea23cd40) has no exports 00000020:00000080:2.0:1783967188.142893:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4eb8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783967188.168350:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783967188.168367:0:21275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1783967188.168372:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a05f1a55800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1783967188.168388:0:21275:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f1a55800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1783967188.168400:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1783967188.168744:0:21275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a05f1a56000 00000020:01000000:3.0:1783967188.168763:0:21275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1783967188.168957:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783967188.168963:0:21275:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783967188.168967:0:21275:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9a05c34ccd40) has no exports 00000020:00000080:3.0:1783967188.168988:0:21275:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783967188.168992:0:21275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1783967188.168995:0:21275:0:(genops.c:906:class_export_put()) final put ffff9a05f4e7a000/OSS_uuid 00000020:00000080:3.0:1783967188.168998:0:21275:0:(genops.c:865:class_export_destroy()) destroying export ffff9a05f4e7a000/OSS_uuid for OSS 00000020:01000000:3.0:1783967188.169001:0:21275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783967188.169237:0:18604:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a05ef9fa000:18604] 2 exiting: rc = 0 00000100:00100000:2.0:1783967188.169379:0:18601:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a05ea614e00:18601] 0 exiting: rc = 1 00000100:00100000:2.0:1783967188.169423:0:19333:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a04c34f1e00:19333] 3 exiting: rc = 0 00000100:00100000:2.0:1783967188.169484:0:18603:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a05c6a80a00:18603] 1 exiting: rc = 0 00000100:00100000:0.0:1783967188.169577:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169586:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169592:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169597:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169601:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169606:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169612:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169618:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169623:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169627:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169632:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169637:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169642:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169647:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169652:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169656:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169661:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169665:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169670:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169674:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169679:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169683:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169688:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169693:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169697:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169702:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169707:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169712:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169717:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169723:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169727:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169732:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169742:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169747:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169752:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169757:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169762:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169804:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169812:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169817:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169822:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169827:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169832:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169838:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169842:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169847:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169852:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169857:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169862:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169866:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169870:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169875:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169880:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169884:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169889:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169893:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169898:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169902:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169906:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169911:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169917:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169922:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169927:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.169932:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1783967188.171677:0:17092:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783967188.176269:0:20236:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a04c3d87a00:20236] 2 exiting: rc = 0 00000100:00100000:0.0:1783967188.180013:0:18605:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a05ef9fa800:18605] 0 exiting: rc = 1 00000100:00100000:3.0:1783967188.182632:0:18606:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a05ef9fbe00:18606] 1 exiting: rc = 0 00000100:00100000:0.0:1783967188.184733:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184742:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184758:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184763:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184794:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184801:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184806:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184811:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184817:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184822:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184827:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184833:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184838:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184843:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184848:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184853:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184859:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184864:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184870:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184874:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184881:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184885:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184898:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184912:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184919:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184924:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184928:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184933:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184938:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184943:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184949:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184953:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184958:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184962:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184967:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184971:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184976:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184990:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.184997:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185002:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185007:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185012:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185016:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185021:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185026:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185031:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185035:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185040:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185045:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185049:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185054:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185060:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185065:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185077:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185084:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185090:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185095:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185100:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185733:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185745:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185755:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185761:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185802:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.185810:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.188027:0:18609:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a05c6944c00:18609] 2 exiting: rc = 0 00000100:00100000:3.0:1783967188.188436:0:18607:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a05ef9fa200:18607] 0 exiting: rc = 1 00000100:00100000:2.0:1783967188.190621:0:18608:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a05c6945600:18608] 1 exiting: rc = 0 00000100:00100000:0.0:1783967188.191311:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191321:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191327:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191343:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191351:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191357:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191364:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191381:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191387:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191393:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191398:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191403:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191472:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191481:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191487:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191492:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191498:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191504:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191510:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191516:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191522:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191528:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191534:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191539:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191544:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191549:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191555:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191561:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191567:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191573:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191579:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191584:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191590:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191597:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191603:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191609:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191629:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191636:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191642:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191647:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191652:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191658:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191671:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191678:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191683:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191689:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191695:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191701:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191706:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191712:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191717:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191723:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191730:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191736:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191742:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191747:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191753:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191759:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.191765:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.192008:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.192023:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.192036:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.192044:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783967188.192050:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.199115:0:18610:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a05e0905000:18610] 0 exiting: rc = 1 00000100:00100000:3.0:1783967188.199317:0:18611:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a05e0905200:18611] 1 exiting: rc = 0 00000100:00100000:2.0:1783967188.199479:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199489:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199494:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199500:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199506:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199511:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199517:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199523:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199528:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199534:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199539:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199545:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199550:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199555:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199561:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199566:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199571:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199576:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199583:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199590:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199596:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199601:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199607:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199612:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199618:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199623:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199628:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199634:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199639:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199644:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199650:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199655:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199675:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199680:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199686:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199690:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199695:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199700:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199705:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199710:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199716:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199721:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199734:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199741:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199747:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199752:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.199761:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200221:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200232:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200237:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200242:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200247:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200252:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200257:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200262:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200267:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200272:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200277:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200283:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200287:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200292:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200299:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200305:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.200310:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783967188.201756:0:18612:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a05cf06b800:18612] 0 exiting: rc = 1 00000100:00100000:3.0:1783967188.202090:0:18613:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a05f5654600:18613] 1 exiting: rc = 0 00000100:00100000:2.0:1783967188.202734:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.202741:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.202753:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.204061:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.204068:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.204074:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.204080:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.204085:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.204091:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205006:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205023:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205056:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205063:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205069:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205075:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205081:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205086:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205092:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205098:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205175:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205183:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205189:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205195:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205215:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205222:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205228:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205233:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205240:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205247:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205253:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205259:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205264:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205270:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205276:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205282:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205303:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205309:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205315:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205337:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205343:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205349:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205355:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205361:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205367:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205373:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205379:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205386:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205404:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205412:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205417:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205423:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205429:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205437:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205442:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205448:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205455:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205461:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205466:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205471:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205491:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205499:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205505:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205511:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783967188.205525:0:21275:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1783967188.231300:0:21275:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783967207.213612:0:22040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783967219.080386:0:22641:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783967219.080393:0:22641:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1783967219.080395:0:22641:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1783967219.081140:0:22641:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a04c31ac800 00000020:01000004:2.0:1783967219.081157:0:22641:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1783967219.081164:0:22641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783967219.081175:0:22641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a04c3478000) 00000020:00000080:2.0:1783967219.081187:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1783967219.158608:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.161045:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1783967219.165612:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1783967219.166796:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.167237:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.167574:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783967219.167763:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783967219.168285:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783967219.168583:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783967219.168793:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.169207:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.169857:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.170187:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1783967219.170756:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1783967219.171011:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.171576:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783967219.171752:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.175416:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.176715:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1783967219.177398:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1783967219.177795:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783967219.178299:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.178625:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.179596:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.181627:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.182384:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1783967219.184314:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1783967219.184653:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1783967219.190272:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1783967219.190748:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1783967219.191822:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1783967219.192580:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1783967219.192803:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1783967219.193292:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1783967219.193572:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1783967219.194627:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783967219.195352:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.195648:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1783967219.195849:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.196597:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.196807:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783967219.197262:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.197486:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783967219.197754:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1783967219.198333:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.198615:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1783967219.198804:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.200708:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.201304:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.201572:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.202576:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.202826:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1783967219.203242:0:22641:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1783967219.204248:0:22641:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783967219.204456:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783967219.204463:0:22641:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783967219.204473:0:22641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b3160687e5 00000020:01000004:0.0:1783967219.204479:0:22641:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1783967219.204483:0:22641:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783967219.204487:0:22641:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a04c31ac800 from MGS 00000020:01000004:0.0:1783967219.204491:0:22641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783967219.204509:0:22641:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a05c34c99c0) 00000020:00000080:0.0:1783967219.204519:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783967219.204629:0:22641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c31ac800 from MGS, refs=2 00080000:01000000:0.0:1783967219.204635:0:22641:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783967219.204639:0:22641:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b3160687f3 00000100:00100000:0.0:1783967219.204743:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783967219.204869:0:22641:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783967219.204876:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783967219.211372:0:22641:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783967219.211384:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783967219.213304:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967219.213654:0:22641:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783967219.213659:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783967219.216000:0:22641:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783967219.216011:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783967219.217129:0:22641:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783967219.217136:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783967219.219428:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967219.219433:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967219.219435:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967219.219712:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967219.219714:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967219.219716:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967219.222169:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967219.222983:0:22641:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:1.0:1783967219.231587:0:22641:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1783967219.245304:0:22653:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783967219.246233:0:22641:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783967219.246291:0:22641:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783967219.248706:0:22641:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783967219.249823:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967219.253693:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783967219.253704:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783967219.260271:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783967219.260285:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783967219.261056:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783967219.261063:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783967219.266526:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783967219.266562:0:22641:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.159@tcp' 00000020:01000004:2.0:1783967219.266564:0:22641:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783967219.266590:0:22641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.159@tcp (typ=mgc) 00000020:00000080:2.0:1783967219.266601:0:22641:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.159@tcp (ffff9a04c34799c0) 00000020:00000080:2.0:1783967219.266622:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783967219.266707:0:22641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05e77e0800@MGC192.168.204.159@tcp: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1783967219.267484:0:22641:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.159@tcp-0 is initialized 00000040:01000000:2.0:1783967219.267491:0:22641:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 1 is initialized 00000100:00080000:0.0:1783967219.267875:0:22658:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1783967219.270442:0:22659:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783967219.270521:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.159@tcp (uuid 23275f43-9903-4089-8dbf-9caac6a945f7) 00000020:00000080:2.0:1783967219.270553:0:22641:0:(genops.c:1406:class_connect()) connect: client 23275f43-9903-4089-8dbf-9caac6a945f7, cookie 0x9269c8b316068801 00000100:00080000:2.0:1783967219.270566:0:22641:0:(import.c:510:import_select_connection()) MGC192.168.204.159@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783967219.270572:0:22641:0:(import.c:624:import_select_connection()) MGC192.168.204.159@tcp: import ffff9a05e77e0800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967219.270601:0:22641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba45c00 x1870624588012416/t0(0) o250->MGC192.168.204.159@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967219.270636:0:22641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 23275f43-9903-4089-8dbf-9caac6a945f7->MGS 00000100:00100000:3.0:1783967219.270706:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:23275f43-9903-4089-8dbf-9caac6a945f7:3644:1870624588012416:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783967219.270792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.270862:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588012416 00000100:00100000:3.0:1783967219.270870:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588012416 00000100:00100000:3.0:1783967219.270920:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967219.270927:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1870624588012416:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1783967219.270948:0:22655:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 23275f43-9903-4089-8dbf-9caac6a945f7@0@lo t0 exp 0000000000000000 cur 695 last 0 00000020:00000080:3.0:1783967219.270974:0:22655:0:(genops.c:1406:class_connect()) connect: client 23275f43-9903-4089-8dbf-9caac6a945f7, cookie 0x9269c8b316068808 00000020:01000004:2.0:1783967219.271430:0:22641:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783967219.271436:0:22641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783967219.271447:0:22641:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a04c347cd40) 00000020:00000080:2.0:1783967219.271458:0:22641:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1783967219.273518:0:22655:0:(import.c:65:import_set_state_nolock()) ffff9a04c31b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967219.273613:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+5:3644:x1870624588012416:12345-0@lo:250:mount.lustre.0 Request processed in 2683us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.273627:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967219.273673:0:3644:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.159@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783967219.273680:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.159@tcp: connect to target with instance 0 00000100:00080000:3.0:1783967219.273687:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.159@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783967219.273691:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783967219.273693:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05e77e0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783967219.273696:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783967219.273702:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783967219.273706:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:23275f43-9903-4089-8dbf-9caac6a945f7:3644:1870624588012416:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783967219.298826:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783967219.299008:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783967219.299014:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783967219.305724:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783967219.305738:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783967219.313793:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783967219.313807:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783967219.315310:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967219.315586:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783967219.315593:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783967219.316578:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783967219.316586:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783967219.383578:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967219.384258:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783967219.384266:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783967219.385752:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783967219.385762:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783967219.387573:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967219.387724:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783967219.387729:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783967219.398461:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783967219.398478:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783967219.400712:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783967219.401144:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783967219.401151:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783967219.404423:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783967219.404434:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783967219.405697:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783967219.406217:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783967219.406223:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783967219.407440:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783967219.407531:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783967219.431306:0:22641:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783967219.431609:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783967219.431617:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783967219.433574:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783967219.433586:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783967219.434464:0:22641:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783967219.434473:0:22641:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783967219.439944:0:22641:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783967219.439976:0:22641:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1783967219.439982:0:22641:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783967219.440571:0:22641:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783967219.440605:0:22641:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783967219.440610:0:22641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783967219.440611:0:22641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783967219.440612:0:22641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967219.440613:0:22641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967219.440615:0:22641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967219.440616:0:22641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967219.440617:0:22641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967219.440618:0:22641:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783967219.440621:0:22641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967219.440622:0:22641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783967219.440626:0:22641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783967219.440628:0:22641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783967219.440630:0:22641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783967219.440631:0:22641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967219.440632:0:22641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967219.440633:0:22641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967219.440634:0:22641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967219.440636:0:22641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967219.440637:0:22641:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783967219.440643:0:22641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967219.440644:0:22641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783967219.440667:0:22641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783967219.440687:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012544:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783967219.440753:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.441745:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967219.442450:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588012544 00000100:00100000:1.0:1783967219.442458:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588012544 00000100:00100000:1.0:1783967219.442549:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967219.442559:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+5:22641:x1870624588012544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783967219.442616:0:22657:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783967219.442621:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783967219.442624:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1783967219.443514:0:22678:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783967219.444500:0:22657:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1783967219.450609:0:22679:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1783967219.450622:0:22679:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1783967219.450625:0:22679:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1783967219.450628:0:22679:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1783967219.451141:0:22679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1783967219.451352:0:22657:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783967219.451363:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783967219.454603:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+5:22641:x1870624588012544:12345-0@lo:253:mount.lustre.0 Request processed in 12036us (13840us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967219.454623:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967219.454722:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012544:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783967219.454736:0:22641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783967219.454739:0:22641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783967219.454741:0:22641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783967219.454742:0:22641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967219.454743:0:22641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967219.454745:0:22641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967219.454747:0:22641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967219.454748:0:22641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967219.454750:0:22641:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783967219.454752:0:22641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967219.454753:0:22641:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783967219.455170:0:22641:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a04c31ac800 from lustre-MDT0000 10000000:01000000:0.0:1783967219.455299:0:22641:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783967219.455303:0:22641:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783967219.455307:0:22641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a04c34799c0 10000000:01000000:0.0:1783967219.455415:0:22641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783967219.455423:0:22641:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a04c34799c0 from 1 10000000:01000000:0.0:1783967219.455426:0:22641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783967219.455465:0:22641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.455492:0:22641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.455502:0:22641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.455522:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012672:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967219.455572:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.455612:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783967219.455670:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588012672 00000100:00100000:1.0:1783967219.455676:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588012672 00000100:00100000:1.0:1783967219.455763:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967219.456158:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+5:22641:x1870624588012672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967219.456170:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967219.456503:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0200/0x9269c8b31606881d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068816 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.456529:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0200/0x9269c8b31606881d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068816 expref: 6 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.456550:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0200/0x9269c8b31606881d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068816 expref: 6 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.456559:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0200, rc 0) 00000100:00100000:1.0:1783967219.456648:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+6:22641:x1870624588012672:12345-0@lo:101:mount.lustre.0 Request processed in 493us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967219.456656:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967219.456713:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967219.456727:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.456736:0:22641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967219.457470:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967219.457502:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.457569:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.457614:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588012800 00000100:00100000:0.0:1783967219.457620:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588012800 00000100:00100000:0.0:1783967219.457656:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783967219.457663:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+6:22641:x1870624588012800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967219.457837:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+6:22641:x1870624588012800:12345-0@lo:501:mount.lustre.0 Request processed in 174us (333us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783967219.457844:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967219.458465:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012800:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783967219.458495:0:22641:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783967219.458563:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.458573:0:22641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967219.458580:0:22641:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a04c31ac800 10000000:01000000:1.0:1783967219.458585:0:22641:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783967219.458599:0:22641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a04c31ac800 10000000:01000000:1.0:1783967219.458601:0:22641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783967219.458604:0:22641:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a04c31ac800 from 1 10000000:01000000:1.0:1783967219.458607:0:22641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783967219.458632:0:22641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.458640:0:22641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.458648:0:22641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967219.458662:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967219.458694:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.458727:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.458796:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588012928 00000100:00100000:0.0:1783967219.458801:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588012928 00000100:00100000:0.0:1783967219.458835:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783967219.458842:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+6:22641:x1870624588012928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967219.458857:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967219.458869:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050800/0x9269c8b31606882b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068824 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.458896:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050800/0x9269c8b31606882b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068824 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.458920:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050800/0x9269c8b31606882b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068824 expref: 7 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.458929:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050800, rc 0) 00000100:00100000:0.0:1783967219.458964:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+7:22641:x1870624588012928:12345-0@lo:101:mount.lustre.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967219.458970:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967219.459141:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588012928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967219.459151:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606882b expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.459160:0:22641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606882b expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967219.459172:0:22641:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783967219.459648:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606882b expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.459657:0:22641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0800/0x9269c8b316068824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606882b expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967219.459674:0:22641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783967219.459678:0:22641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783967219.459683:0:22641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a04c31ac800 10000000:01000000:1.0:1783967219.459685:0:22641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783967219.459688:0:22641:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783967219.459690:0:22641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783967219.459707:0:22641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.459714:0:22641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.459720:0:22641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967219.459735:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588013056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783967219.459764:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.459815:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.459874:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588013056 00000100:00100000:0.0:1783967219.459889:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588013056 00000100:00100000:0.0:1783967219.460137:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967219.460145:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+7:22641:x1870624588013056:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967219.460153:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967219.460162:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050e00/0x9269c8b316068839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068832 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.460417:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050e00/0x9269c8b316068839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068832 expref: 8 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.460427:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050e00/0x9269c8b316068839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068832 expref: 8 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.460434:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050e00, rc 0) 00000100:00100000:0.0:1783967219.460483:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+8:22641:x1870624588013056:12345-0@lo:101:mount.lustre.0 Request processed in 339us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967219.460491:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783967219.460569:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588013056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967219.460581:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068839 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.460589:0:22641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068839 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967219.460646:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588013184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967219.460671:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.460708:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af780 going to sleep for 11 seconds 00000100:00100000:2.0:1783967219.460806:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588013184 00000100:00100000:2.0:1783967219.460811:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588013184 00000100:00100000:2.0:1783967219.460849:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783967219.460856:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+8:22641:x1870624588013184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967219.461469:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+9:22641:x1870624588013184:12345-0@lo:501:mount.lustre.0 Request processed in 613us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967219.461476:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967219.461698:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588013184:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967219.461722:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588013312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967219.461760:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.462166:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31af780 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.462412:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588013312 00000100:00100000:0.0:1783967219.462417:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588013312 00000100:00100000:2.0:1783967219.462570:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783967219.462579:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+9:22641:x1870624588013312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967219.463701:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+9:22641:x1870624588013312:12345-0@lo:503:mount.lustre.0 Request processed in 1121us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967219.463710:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967219.463823:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588013312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967219.464545:0:22680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22680:1870624588013440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967219.464590:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.465171:0:22680:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d31cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967219.465689:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588013440 00000100:00100000:1.0:1783967219.465695:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588013440 00000100:00100000:1.0:1783967219.465737:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967219.465746:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+9:22680:x1870624588013440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783967219.466846:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+9:22680:x1870624588013440:12345-0@lo:502:llog_process_th.0 Request processed in 1100us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967219.466856:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967219.467571:0:22680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22680:1870624588013440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783967219.467602:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967219.467613:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.467621:0:22680:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783967219.467626:0:22680:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783967219.467629:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967219.467642:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a04c24999c0) 00000020:00000080:3.0:1783967219.467657:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783967219.467661:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783967219.467734:0:22680:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783967219.467741:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316068847 00000020:00000080:3.0:1783967219.468815:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783967219.468822:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967219.468827:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.468829:0:22680:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783967219.468831:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967219.468835:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.468836:0:22680:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783967219.468840:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967219.468848:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a04c2498000) 00000020:00000080:3.0:1783967219.468863:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783967219.468867:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783967219.468868:0:22680:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783967219.468871:0:22680:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783967219.468877:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783967219.469508:0:22680:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c31ac800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783967219.469523:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a04c249b380) 00000020:00000080:3.0:1783967219.469542:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783967219.469603:0:22680:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783967219.469611:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b31606885c 00000020:00000080:3.0:1783967219.469709:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783967219.469715:0:22680:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783967219.469719:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9269c8b316068863 00080000:01000000:3.0:1783967219.469724:0:22680:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783967219.469728:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b31606886a 00010000:00010000:0.0:1783967219.608575:0:22680:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1783967219.609819:0:22680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:0.0:1783967219.611793:0:22680:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1783967219.614142:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a05c34cb380) 00000020:00000080:0.0:1783967219.614178:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1783967219.614283:0:22680:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:0.0:1783967219.614291:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b316068878 00000020:00000080:0.0:1783967219.614874:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783967219.660968:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9269c8b31606887f 00000020:00000080:3.0:1783967219.662375:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783967219.662387:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967219.662399:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.662401:0:22680:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783967219.662405:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783967219.662408:0:22680:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1783967219.662409:0:22680:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967219.662411:0:22680:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967219.662412:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783967219.662415:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.662416:0:22680:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783967219.662419:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967219.662423:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.662424:0:22680:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783967219.662428:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783967219.662475:0:22680:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783967219.662489:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967219.662492:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.662494:0:22680:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783967219.662497:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967219.662500:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.662501:0:22680:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1783967219.662504:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783967219.662509:0:22680:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:00000080:3.0:1783967219.662547:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967219.662561:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a04c249cd40) 00000020:00000080:3.0:1783967219.662577:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783967219.662583:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783967219.662638:0:22680:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1783967219.662657:0:22680:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783967219.662664:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b31606888d 00010000:00080000:3.0:1783967219.662694:0:22680:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c375a800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967219.664315:0:22680:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1783967219.680868:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783967219.680882:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1783967219.680935:0:22680:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783967219.680956:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316068894 00000100:00080000:3.0:1783967219.680967:0:22680:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967219.680972:0:22680:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c375a800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967219.681006:0:22680:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77e9500 x1870624588013568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967219.681033:0:22680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1783967219.681092:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967219.681096:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.681098:0:22680:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1783967219.681101:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783967219.681104:0:22680:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1783967219.681105:0:22680:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967219.681107:0:22680:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783967219.681108:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783967219.681110:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.681112:0:22680:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783967219.681115:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783967219.681121:0:22680:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1783967219.681124:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967219.681125:0:22680:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783967219.681128:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783967219.681132:0:22680:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:3.0:1783967219.681156:0:22680:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783967219.681158:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967219.681171:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a05ea23cd40) 00000020:00000080:3.0:1783967219.681183:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1783967219.681187:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783967219.681237:0:22680:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783967219.681242:0:22680:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783967219.681248:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b3160688a2 00010000:00080000:3.0:1783967219.681286:0:22680:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c3cc2800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967219.681481:0:22680:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1783967219.683100:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588013568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783967219.683169:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.684268:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588013568 00000100:00100000:3.0:1783967219.684277:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588013568 00000040:01000000:2.0:1783967219.684430:0:22680:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783967219.684737:0:22680:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783967219.684932:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783967219.684940:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588013568:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1783967219.684958:0:22667:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:00080000:2.0:1783967219.687843:0:22680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967219.688796:0:22680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1783967219.703523:0:22680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1783967219.704212:0:22686:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783967219.704217:0:22686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783967219.706594:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783967219.706610:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783967219.706653:0:22680:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783967219.706674:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b3160688a9 00000100:00080000:2.0:1783967219.706684:0:22680:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783967219.706690:0:22680:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a04c3cc2800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967219.706725:0:22680:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba45500 x1870624588013696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967219.706755:0:22680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783967219.706844:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967219.706848:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.706850:0:22680:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783967219.706853:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783967219.706862:0:22680:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1783967219.706864:0:22680:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783967219.706865:0:22680:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783967219.706867:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783967219.706870:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.706883:0:22680:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783967219.706886:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783967219.706891:0:22680:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1783967219.706894:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.706896:0:22680:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783967219.706952:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783967219.706956:0:22680:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000100:00100000:0.0:1783967219.706965:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588013696:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1783967219.706977:0:22680:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783967219.706979:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783967219.706990:0:22680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a04c347b380) 00000020:00000080:2.0:1783967219.707000:0:22680:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1783967219.707004:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000400:00000100:0.0:1783967219.707014:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588013696 offset 0 length 520: 4 00000004:00080000:2.0:1783967219.707377:0:22680:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783967219.707384:0:22680:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1783967219.707391:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9269c8b3160688b7 00010000:00080000:2.0:1783967219.707420:0:22680:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c1f6f000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:2.0:1783967219.707699:0:22680:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1783967219.707764:0:22680:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783967219.707796:0:22680:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1783967219.708120:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588013568:12345-0@lo:38:llog_process_th.0 Request processed in 23177us (24949us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783967219.708132:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783967219.708304:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967219.708309:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967219.708313:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588013568:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783967219.712872:0:22680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967219.713172:0:22680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1783967219.713509:0:22680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1783967219.714100:0:22688:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783967219.714105:0:22688:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783967219.714999:0:22680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783967219.715083:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783967219.715132:0:22680:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783967219.715154:0:22680:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b3160688be 00000100:00080000:2.0:1783967219.715165:0:22680:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783967219.715176:0:22680:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967219.715268:0:22680:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba46a00 x1870624588013824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967219.715319:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588013824:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783967219.715390:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588013824 offset 0 length 520: 4 00000100:00080000:2.0:1783967219.715498:0:22680:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1783967219.718008:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967219.718016:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.718018:0:22680:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783967219.718021:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967219.718025:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.718026:0:22680:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783967219.718030:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783967219.718031:0:22680:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783967219.718033:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967219.718036:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.718037:0:22680:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783967219.718038:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783967219.718040:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.718042:0:22680:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783967219.718045:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783967219.718092:0:22680:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22680:1870624588013952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967219.718168:0:22680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967219.718322:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588013952 00000100:00100000:2.0:1783967219.718328:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588013952 00000100:00100000:2.0:1783967219.718381:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967219.718391:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+9:22680:x1870624588013952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783967219.718502:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+9:22680:x1870624588013952:12345-0@lo:502:llog_process_th.0 Request processed in 112us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967219.718509:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967219.718568:0:22680:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3298480 going to sleep for 11 seconds 00000100:00100000:2.0:1783967219.718589:0:22680:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22680:1870624588013952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783967219.718617:0:22680:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783967219.718621:0:22680:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967219.718623:0:22680:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783967219.718627:0:22680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1783967219.719149:0:22641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1783967219.719172:0:22641:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783967219.719455:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068839 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.719480:0:22641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0400/0x9269c8b316068832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068839 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967219.719489:0:22641:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a04c31ac800 from 1 10000000:01000000:0.0:1783967219.719492:0:22641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967219.719521:0:22641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.719536:0:22641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.719546:0:22641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.719564:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967219.719601:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.719629:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783967219.719715:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014080 00000100:00100000:2.0:1783967219.719731:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014080 00000100:00100000:2.0:1783967219.719888:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967219.719897:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+9:22641:x1870624588014080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967219.719907:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967219.719922:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160688c5 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967219.719943:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967219.719953:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 10 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967219.719960:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631a00, rc 0) 00000100:00100000:2.0:1783967219.720002:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+10:22641:x1870624588014080:12345-0@lo:101:mount.lustre.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967219.720009:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783967219.720086:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967219.720099:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.720108:0:22641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.721093:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014208:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783967219.721137:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.721325:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967219.721947:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014208 00000100:00100000:1.0:1783967219.721954:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014208 00000100:00100000:1.0:1783967219.721997:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967219.722006:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+10:22641:x1870624588014208:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783967219.722025:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783967219.722031:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783967219.722103:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+10:22641:x1870624588014208:12345-0@lo:256:mount.lustre.0 Request processed in 98us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967219.722110:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783967219.722221:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014208:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783967219.723009:0:22641:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783967219.723066:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.723077:0:22641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967219.723084:0:22641:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c31ac800 from 1 10000000:01000000:0.0:1783967219.723086:0:22641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967219.723114:0:22641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.723121:0:22641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.723129:0:22641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.723145:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967219.723182:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.723230:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.723424:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014336 00000100:00100000:3.0:1783967219.723430:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014336 00000100:00100000:3.0:1783967219.723474:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967219.723482:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+10:22641:x1870624588014336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967219.723491:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967219.723505:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160688d3 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.723525:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.723548:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.723556:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179400, rc 0) 00000100:00100000:3.0:1783967219.723597:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588014336:12345-0@lo:101:mount.lustre.0 Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.723603:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783967219.724009:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967219.724022:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.724032:0:22641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.724102:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967219.724129:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.724160:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.724403:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014464 00000100:00100000:3.0:1783967219.724408:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014464 00000100:00100000:3.0:1783967219.724433:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783967219.724441:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588014464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967219.724625:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588014464:12345-0@lo:501:mount.lustre.0 Request processed in 184us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.724633:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967219.725928:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967219.726037:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967219.726087:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.726144:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783967219.726185:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014592 00000100:00100000:1.0:1783967219.726249:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014592 00000100:00100000:1.0:1783967219.726324:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783967219.726333:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588014592:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967219.726453:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588014592:12345-0@lo:503:mount.lustre.0 Request processed in 121us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967219.726461:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783967219.726541:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967219.727032:0:22690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22690:1870624588014720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.727066:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.727245:0:22690:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.727596:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014720 00000100:00100000:3.0:1783967219.727601:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014720 00000100:00100000:3.0:1783967219.727631:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783967219.727638:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22690:x1870624588014720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967219.728379:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22690:x1870624588014720:12345-0@lo:502:llog_process_th.0 Request processed in 739us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.728388:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783967219.728679:0:22690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22690:1870624588014720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783967219.728710:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967219.728720:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.728888:0:22690:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783967219.728898:0:22690:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a04c31ac800 00000020:00000080:0.0:1783967219.728901:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967219.728909:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967219.728911:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.728913:0:22690:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783967219.728915:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967219.728918:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.728919:0:22690:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783967219.728923:0:22690:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a04c31ac800 00000020:00000080:0.0:1783967219.728925:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967219.729019:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967219.729023:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.729031:0:22690:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783967219.729034:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967219.729037:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.729038:0:22690:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783967219.729042:0:22690:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a04c31ac800 00000020:00000080:0.0:1783967219.729044:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967219.729655:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967219.729660:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.729662:0:22690:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783967219.729665:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967219.729667:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967219.729668:0:22690:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783967219.729672:0:22690:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a04c31ac800 00000020:00000080:0.0:1783967219.729674:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783967219.729798:0:22690:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22690:1870624588014848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.729955:0:22690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.729980:0:22690:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.730380:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014848 00000100:00100000:3.0:1783967219.730386:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014848 00000100:00100000:3.0:1783967219.730432:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783967219.730442:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22690:x1870624588014848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967219.730559:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22690:x1870624588014848:12345-0@lo:502:llog_process_th.0 Request processed in 118us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.730565:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783967219.730871:0:22690:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22690:1870624588014848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783967219.730895:0:22690:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967219.730900:0:22690:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967219.730901:0:22690:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783967219.730905:0:22690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1783967219.731322:0:22641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1783967219.731343:0:22641:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783967219.731359:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.731371:0:22641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967219.731425:0:22641:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783967219.731428:0:22641:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a04c31ac800 10000000:01000000:3.0:1783967219.731431:0:22641:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a04c31ac800 10000000:01000000:3.0:1783967219.731435:0:22641:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783967219.731440:0:22641:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a04c31ac800 from 1 10000000:01000000:3.0:1783967219.731442:0:22641:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783967219.731469:0:22641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.731478:0:22641:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.731488:0:22641:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967219.731504:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967219.731547:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.731573:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5f42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.732593:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588014976 00000100:00100000:3.0:1783967219.732600:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588014976 00000100:00100000:3.0:1783967219.732644:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783967219.732652:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588014976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967219.732664:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967219.732677:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602178a00/0x9269c8b3160688e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160688e1 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.732712:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602178a00/0x9269c8b3160688e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160688e1 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.732732:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602178a00/0x9269c8b3160688e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160688e1 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.732741:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602178a00, rc 0) 00000100:00100000:3.0:1783967219.732817:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22641:x1870624588014976:12345-0@lo:101:mount.lustre.0 Request processed in 165us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.732824:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783967219.732867:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588014976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967219.732882:0:22641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688e8 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.732890:0:22641:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160688e8 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967219.732945:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588015104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967219.732972:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.732992:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5f42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.733007:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015104 00000100:00100000:3.0:1783967219.733011:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015104 00000100:00100000:3.0:1783967219.733028:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967219.733034:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22641:x1870624588015104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967219.733134:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22641:x1870624588015104:12345-0@lo:501:mount.lustre.0 Request processed in 100us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.733141:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783967219.733171:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588015104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967219.733848:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588015232:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967219.733886:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.733901:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c5f42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.733916:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015232 00000100:00100000:3.0:1783967219.733920:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015232 00000100:00100000:3.0:1783967219.733941:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783967219.733949:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22641:x1870624588015232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967219.734028:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22641:x1870624588015232:12345-0@lo:503:mount.lustre.0 Request processed in 79us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.734036:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783967219.734078:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588015232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967219.742408:0:22692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22692:1870624588015360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.742488:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.742540:0:22692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967219.742889:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015360 00000100:00100000:3.0:1783967219.742898:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015360 00000100:00100000:3.0:1783967219.742990:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783967219.743001:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22692:x1870624588015360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783967219.743119:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22692:x1870624588015360:12345-0@lo:502:llog_process_th.0 Request processed in 120us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967219.743128:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783967219.745708:0:22692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22692:1870624588015360:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783967219.745806:0:22692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783967219.745824:0:22692:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a04c3144d40) 00000020:00000080:1.0:1783967219.745844:0:22692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1783967219.746015:0:22692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c31ac800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783967219.746019:0:22692:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a04c31ac800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783967219.746022:0:22692:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c31ac800 4 00010000:00080000:1.0:1783967219.746055:0:22692:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05c2f6c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783967219.747493:0:22692:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1783967219.747588:0:22692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783967219.747625:0:22692:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783967219.747638:0:22692:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9269c8b3160688f6 00000100:00080000:1.0:1783967219.747646:0:22692:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783967219.747651:0:22692:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a05c2f6c000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967219.747681:0:22692:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f10e00 x1870624588015488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967219.747716:0:22692:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783967219.749911:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624588015488:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783967219.749985:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.750135:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015488 00000100:00100000:0.0:1783967219.750142:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015488 00000100:00100000:0.0:1783967219.750171:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967219.750178:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588015488:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783967219.750231:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588015488:12345-0@lo:38:llog_process_th.0 Request processed in 51us (245us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783967219.750239:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967219.750282:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783967219.750290:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05c2f6c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967219.750294:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783967219.750298:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624588015488:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967219.751713:0:22692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22692:1870624588015616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783967219.751885:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.751919:0:22692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8bc36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.752857:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015616 00000100:00100000:0.0:1783967219.752865:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015616 00000100:00100000:0.0:1783967219.752909:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783967219.752919:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:22692:x1870624588015616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.753044:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:22692:x1870624588015616:12345-0@lo:502:llog_process_th.0 Request processed in 125us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967219.753051:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783967219.753102:0:22692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22692:1870624588015616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.753147:0:22692:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22692:1870624588015744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.753182:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.753199:0:22692:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.753212:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015744 00000100:00100000:0.0:1783967219.753215:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015744 00000100:00100000:0.0:1783967219.753240:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783967219.753246:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:22692:x1870624588015744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783967219.753305:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:22692:x1870624588015744:12345-0@lo:502:llog_process_th.0 Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967219.753312:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783967219.753344:0:22692:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:23275f43-9903-4089-8dbf-9caac6a945f7:22692:1870624588015744:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783967219.753362:0:22692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1783967219.753865:0:22641:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783967219.753889:0:22641:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783967219.753904:0:22641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688e8 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967219.753915:0:22641:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602178e00/0x9269c8b3160688e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160688e8 expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783967219.753969:0:22641:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783967219.753971:0:22641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783967219.753972:0:22641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967219.753973:0:22641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967219.753974:0:22641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967219.753975:0:22641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967219.753976:0:22641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783967219.753978:0:22641:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783967219.753979:0:22641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967219.753981:0:22641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783967219.753985:0:22641:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783967219.753987:0:22641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783967219.753988:0:22641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783967219.753989:0:22641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967219.753990:0:22641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967219.753991:0:22641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967219.753992:0:22641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967219.753993:0:22641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783967219.753994:0:22641:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783967219.753995:0:22641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967219.753996:0:22641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783967219.754009:0:22641:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783967219.754019:0:22641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588015872:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783967219.754051:0:22641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967219.754070:0:22641:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.756976:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588015872 00000100:00100000:0.0:1783967219.756994:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588015872 00000100:00100000:0.0:1783967219.757041:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783967219.757050:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:22641:x1870624588015872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783967219.757080:0:22656:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783967219.757093:0:22656:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783967219.761954:0:22656:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783967219.761968:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783967219.762939:0:22678:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783967219.762945:0:22678:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783967219.762968:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.762988:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.762997:0:22678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.763037:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967219.763054:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 12 pid: 22655 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967219.763068:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588016000:0@lo:104: 00000100:00100000:1.0:1783967219.763133:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967219.763179:0:22678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8bc3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783967219.764276:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016000 00000100:00100000:0.0:1783967219.764285:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016000 00000100:00100000:0.0:1783967219.764324:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967219.764333:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588016000:12345-0@lo:104: 00010000:00010000:0.0:1783967219.764346:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.764394:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783967219.764400:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588016000:12345-0@lo:104: Request processed in 68us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967219.764407:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783967219.764429:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967219.764434:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.764442:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967219.764446:0:22651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.764455:0:22651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967219.764462:0:22651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967219.764479:0:22651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783967219.764508:0:22651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.764515:0:22651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783967219.764547:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.764554:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b3160688c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160688cc expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.764567:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967219.764569:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967219.764570:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967219.764606:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588016128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967219.764641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967219.764716:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016128 00000100:00100000:0.0:1783967219.764720:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016128 00010000:00010000:0.0:1783967219.765316:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 13 pid: 22655 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.765343:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967219.765351:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+13:3648:x1870624588016128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967219.765361:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967219.765367:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 13 pid: 22655 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765377:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 13 pid: 22655 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765401:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765409:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783967219.765423:0:22647:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002479094s 00010000:00010000:0.0:1783967219.765428:0:22647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765436:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765442:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765449:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765455:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967219.765459:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765465:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765474:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765483:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967219.765515:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+13:3648:x1870624588016128:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967219.765540:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967219.765579:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588016128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967219.765605:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631a00/0x9269c8b3160688cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160688c5 expref: 12 pid: 22655 timeout: 795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967219.765615:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588016000:0@lo:104: 00010000:00010000:0.0:1783967219.765633:0:22678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765641:0:22678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765646:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967219.765651:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1600/0x9269c8b3160688fd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967219.765855:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+11:22641:x1870624588015872:12345-0@lo:253:mount.lustre.0 Request processed in 8805us (11801us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967219.765864:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783967219.772968:0:22641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:22641:1870624588015872:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783967219.772987:0:22641:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783967219.772990:0:22641:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783967219.772992:0:22641:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783967219.772994:0:22641:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967219.772995:0:22641:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967219.772996:0:22641:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967219.772997:0:22641:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967219.772999:0:22641:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783967219.773000:0:22641:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783967219.773009:0:22641:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967219.773011:0:22641:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783967219.773026:0:22641:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1783967219.811632:0:22641:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1783967219.812377:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1783967219.812669:0:22703:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1783967219.813232:0:22703:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967219.815312:0:22703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783967219.815387:0:22703:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1783967219.816138:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1783967219.816289:0:22702:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1783967219.816294:0:22702:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00080000:0.0:1783967219.817568:0:22704:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a05ee12a680 x1870624588016256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967219.817581:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00000040:01000000:3.0:1783967219.818411:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783967219.818457:0:22641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783967219.819360:0:22641:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783967219.819370:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783967219.819420:0:22641:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967219.825632:0:22641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783967219.826611:0:22641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783967219.826655:0:22641:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783967219.828330:0:22641:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1783967219.829253:0:22641:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1783967219.831416:0:22641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1783967219.833585:0:22641:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783967219.833630:0:22641:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb71ec1967988 00100000:10000000:2.0:1783967219.833639:0:22641:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783967219.834648:0:22641:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783967219.834663:0:22641:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783967219.834695:0:22641:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1783967219.834712:0:22641:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1783967219.844913:0:22641:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783967219.845133:0:22641:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783967220.282303:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967220.791300:0:22698:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783967220.791309:0:22698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783967220.794384:0:22698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783967220.794395:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783967220.855707:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 10000000:01000000:0.0:1783967221.046904:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967221.046912:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a04c31ac800 from 11 10000000:01000000:0.0:1783967221.046917:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967221.046964:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967221.046990:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967221.047003:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967221.047028:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588016384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967221.047092:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967221.047128:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6a780 going to sleep for 11 seconds 00000100:00100000:0.0:1783967221.047146:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016384 00000100:00100000:0.0:1783967221.047151:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016384 00000100:00100000:0.0:1783967221.047345:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783967221.047361:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+11:22659:x1870624588016384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967221.047374:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967221.047394:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068904 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967221.047427:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068904 expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967221.047438:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068904 expref: 12 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967221.047448:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050600, rc 0) 00000100:00100000:0.0:1783967221.047494:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+12:22659:x1870624588016384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967221.047500:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783967221.049798:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588016384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967221.049852:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967221.049866:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967221.050571:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588016512:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783967221.050642:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967221.058399:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016512 00000100:00100000:3.0:1783967221.058416:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016512 00000100:00100000:3.0:1783967221.058481:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783967221.058490:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22659:x1870624588016512:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783967221.058528:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783967221.058543:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783967221.058547:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1783967221.058691:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:22659:x1870624588016512:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (8048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967221.058705:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967221.059430:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783967221.060597:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588016512:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783967221.060662:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783967221.060673:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967221.060683:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967221.303570:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967221.814990:0:22698:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783967221.814999:0:22698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783967221.815118:0:22698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1783967221.815172:0:22698:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783967221.815315:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1783967221.880860:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783967222.327724:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967222.904238:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783967223.355074:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967223.927186:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783967224.385069:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967224.985557:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1783967225.207022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783967225.207108:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783967225.207112:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967225.207120:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 695 00000100:00080000:0.0:1783967225.207126:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783967225.207134:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c375a800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967225.207161:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee12b800 x1870624588016768/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967225.207173:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967225.207177:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967225.207179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967225.207182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967225.207185:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783967225.207189:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783967225.207190:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05c2f6c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967225.207195:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a05c2f6c000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967225.207206:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee128a80 x1870624588016896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967225.207330:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588016640:0@lo:400:kworker.0 00000100:00100000:0.0:1783967225.207408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967225.207488:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016640 00000100:00100000:0.0:1783967225.207496:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016640 00000100:00100000:0.0:1783967225.207542:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967225.207551:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:3645:x1870624588016640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967225.207604:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:3645:x1870624588016640:12345-0@lo:400:kworker.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967225.207613:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783967225.207670:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588016640:0@lo:400:kworker.0 00000100:00100000:2.0:1783967225.208957:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588016768:0@lo:38:kworker.0 00000100:00100000:2.0:1783967225.209020:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967225.209138:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624588016896:0@lo:38:kworker.0 00000100:00100000:2.0:1783967225.209170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967225.209273:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016768 00000100:00100000:2.0:1783967225.209281:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016768 00000100:00100000:2.0:1783967225.209315:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967225.209322:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624588016768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783967225.209342:0:22668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783967225.209383:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624588016768:12345-0@lo:38:kworker.0 Request processed in 62us (363us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967225.209392:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1783967225.209440:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967225.209444:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783967225.209448:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588016768:0@lo:38:kworker.0 00000100:00100000:1.0:1783967225.209643:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016896 00000100:00100000:1.0:1783967225.209649:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016896 00000100:00100000:1.0:1783967225.209714:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967225.209719:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624588016896:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783967225.209744:0:22664:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:1.0:1783967225.209814:0:22664:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9269c8b316068912 00000004:00100000:1.0:1783967225.209841:0:22664:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783967225.209971:0:22664:0:(import.c:65:import_set_state_nolock()) ffff9a05f4fe0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967225.210015:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1870624588016896:12345-0@lo:38:kworker.0 Request processed in 294us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967225.210022:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783967225.210210:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05ee128a80 x1870624588016896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967225.210225:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783967225.210232:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783967225.210237:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783967225.210239:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05c2f6c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783967225.210244:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1870624588016896:0@lo:38:kworker.0 00010000:00010000:1.0:1783967225.400459:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783967225.814593:0:22947:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783967226.039819:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967226.423791:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1783967226.766025:0:22999:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1783967226.766531:0:22999:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783967227.062828:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:1.0:1783967227.453633:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967228.090154:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00000020:00000004:3.0:1783967228.275475:0:23049:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967228.275649:0:23049:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783967228.472093:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967229.112093:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00000100:00100000:1.0:1783967229.305103:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967219/real 1783967219] req@ffff9a05fba46a00 x1870624588013824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967229.305133:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba46a00 x1870624588013824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967229.305144:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967219/real 1783967219] req@ffff9a05fba45500 x1870624588013696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967229 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967229.305155:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba45500 x1870624588013696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967229 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783967229.305174:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967229.305183:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967229.305187:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588013824:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783967229.305193:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967229.305200:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967229.305205:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588013696:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783967229.305454:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783967229.305459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1783967229.305461:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967229.305467:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 701 00000100:00080000:2.0:1783967229.305472:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783967229.305479:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c375a800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967229.305500:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba46a00 x1870624588017152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967229.305515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967229.305518:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783967229.305519:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967229.305522:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 695 00000100:00080000:2.0:1783967229.305525:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967229.305528:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a04c3cc2800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967229.305538:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba45c00 x1870624588017280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967229.305546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967229.305548:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783967229.305550:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967229.305552:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 695 00000100:00080000:2.0:1783967229.305555:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783967229.305557:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967229.305580:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba44e00 x1870624588017408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783967229.305617:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783967229.305630:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588017024:0@lo:400:kworker.0 00000100:00100000:2.0:1783967229.305695:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967229.305741:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588017536:0@lo:400:kworker.0 00000100:00100000:2.0:1783967229.306364:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967229.306412:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588017024 00000100:00100000:2.0:1783967229.306420:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588017024 00000100:00100000:2.0:1783967229.306473:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783967229.306482:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+12:3645:x1870624588017024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967229.306536:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+12:3645:x1870624588017024:12345-0@lo:400:kworker.0 Request processed in 54us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967229.306544:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783967229.306588:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588017536 00000100:00100000:2.0:1783967229.306592:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588017536 00000100:00100000:2.0:1783967229.306619:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783967229.306625:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588017536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967229.306663:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588017536:12345-0@lo:400:kworker.0 Request processed in 38us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967229.306669:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783967229.306707:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05fba45f80 x1870624588017536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967229.306719:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588017536:0@lo:400:kworker.0 00000100:00100000:2.0:1783967229.306745:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588017024:0@lo:400:kworker.0 00000100:00100000:2.0:1783967229.306794:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017152:0@lo:38:kworker.0 00000100:00100000:2.0:1783967229.306826:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967229.306844:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017280:0@lo:8:kworker.0 00000400:00000100:2.0:1783967229.306863:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588017280 offset 0 length 520: 4 00000100:00100000:2.0:1783967229.306881:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017408:0@lo:8:kworker.0 00000400:00000100:2.0:1783967229.306914:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588017408 offset 0 length 520: 4 00000100:00100000:2.0:1783967229.306938:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588017152 00000100:00100000:2.0:1783967229.306942:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588017152 00000100:00100000:2.0:1783967229.306961:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783967229.306965:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624588017152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1783967229.306980:0:22668:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783967229.309098:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624588017152:12345-0@lo:38:kworker.0 Request processed in 2122us (2262us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783967229.309112:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783967229.309166:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967229.309171:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783967229.309175:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017152:0@lo:38:kworker.0 00010000:00010000:2.0:1783967229.496043:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967230.134851:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967230.519317:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967231.033185:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967231.161063:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967231.542984:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967232.189758:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967232.571029:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967233.206900:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967233.590995:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967234.235172:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00000100:00080000:0.0:1783967234.430114:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783967234.430121:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1783967234.430125:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967234.430135:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:0.0:1783967234.430141:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783967234.430150:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c375a800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967234.430176:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee128a80 x1870624588017792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967234.430190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967234.430194:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967234.430197:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967234.430200:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783967234.430294:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967234.430316:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588017920:0@lo:400:kworker.0 00000100:00100000:2.0:1783967234.430330:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588017664:0@lo:400:kworker.0 00000100:00100000:2.0:1783967234.430527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967234.431393:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588017664 00000100:00100000:3.0:1783967234.431403:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588017664 00000100:00100000:3.0:1783967234.431463:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783967234.431475:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:3648:x1870624588017664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967234.431537:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+12:3648:x1870624588017664:12345-0@lo:400:kworker.0 Request processed in 64us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967234.431544:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783967234.432877:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588017664:0@lo:400:kworker.0 00000100:00100000:1.0:1783967234.433817:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017792:0@lo:38:kworker.0 00000100:00100000:1.0:1783967234.433874:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967234.433932:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588017792 00000100:00100000:3.0:1783967234.433939:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588017792 00000100:00100000:3.0:1783967234.433986:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783967234.433993:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588017792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1783967234.434011:0:22667:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1783967234.434054:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588017792:12345-0@lo:38:kworker.0 Request processed in 60us (178us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783967234.434061:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783967234.434272:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967234.434279:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967234.434284:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017792:0@lo:38:kworker.0 00000100:00100000:0.0:1783967234.435787:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967234.435827:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588017920 00000100:00100000:1.0:1783967234.435836:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588017920 00000100:00100000:1.0:1783967234.435901:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967234.435913:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588017920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967234.435983:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588017920:12345-0@lo:400:kworker.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967234.435993:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783967234.436015:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05ee12b800 x1870624588017920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967234.436030:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588017920:0@lo:400:kworker.0 00010000:00010000:2.0:1783967234.614976:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967235.256541:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967235.639261:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967236.279004:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:2.0:1783967236.663903:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967237.312459:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00000020:01000004:0.0:1783967237.368623:0:23394:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783967237.368629:0:23394:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1783967237.368631:0:23394:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1783967237.369304:0:23394:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05c371f800 00000020:01000004:0.0:1783967237.369329:0:23394:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1783967237.369345:0:23394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1783967237.369365:0:23394:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a05c34ccd40) 00000020:00000080:0.0:1783967237.369386:0:23394:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783967237.513987:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1783967237.515053:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783967237.516957:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1783967237.517961:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1783967237.521439:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783967237.523899:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1783967237.525336:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1783967237.525989:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783967237.526987:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1783967237.527566:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783967237.528113:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1783967237.529292:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783967237.529987:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783967237.534486:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1783967237.542503:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1783967237.542933:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1783967237.544867:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1783967237.546097:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1783967237.547279:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1783967237.547585:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.555473:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.556234:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.556756:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.557422:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.557886:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.558144:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.559847:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.560537:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.560931:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.561263:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.561944:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.563435:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.564040:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.565939:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.567380:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.570278:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.571115:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.571572:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.571947:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.574286:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.574988:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.575337:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.575798:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1783967237.577335:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.578561:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1783967237.579209:0:23394:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00080000:01000000:3.0:1783967237.586568:0:23394:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783967237.587073:0:23394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1783967237.587086:0:23394:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783967237.587100:0:23394:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068920 00000020:01000004:3.0:1783967237.587107:0:23394:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1783967237.587128:0:23394:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783967237.587131:0:23394:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783967237.587137:0:23394:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1783967237.587161:0:23394:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1783967237.587165:0:23394:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1783967237.602292:0:23394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783967237.602447:0:23394:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1783967237.602452:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783967237.602453:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783967237.602460:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967237.602461:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967237.602462:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967237.602463:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967237.602465:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783967237.602466:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967237.602468:0:23394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783967237.602471:0:23394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1783967237.602474:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783967237.602475:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783967237.602476:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967237.602477:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967237.602478:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967237.602479:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967237.602480:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783967237.602481:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967237.602481:0:23394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783967237.602511:0:23394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1783967237.602532:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018048:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783967237.602599:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.602650:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001480 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.602974:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018048 00000100:00100000:2.0:1783967237.602982:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018048 00000100:00100000:2.0:1783967237.603034:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783967237.603043:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:23394:x1870624588018048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783967237.603072:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783967237.603076:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1783967237.603083:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1783967237.603409:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:23394:x1870624588018048:12345-0@lo:253:mount.lustre.0 Request processed in 365us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.603416:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967237.603602:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018048:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783967237.603614:0:23394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1783967237.603617:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783967237.603619:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1783967237.603620:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967237.603621:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967237.603622:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967237.603623:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967237.603624:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783967237.603625:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967237.603627:0:23394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783967237.603645:0:23394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05c371f800 from lustre-MDT0001 10000000:01000000:3.0:1783967237.603669:0:23394:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1783967237.603672:0:23394:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783967237.603678:0:23394:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a04c34799c0 local copy 00010000:00010000:3.0:1783967237.603687:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.604631:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967237.604668:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967237.604721:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018176 00000100:00100000:2.0:1783967237.604727:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018176 00000100:00100000:2.0:1783967237.604844:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783967237.604864:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+12:23394:x1870624588018176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967237.604931:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+12:23394:x1870624588018176:12345-0@lo:501:mount.lustre.0 Request processed in 79us (262us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783967237.604945:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967237.605298:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0013c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967237.605862:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018176:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783967237.605889:0:23394:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783967237.605917:0:23394:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783967237.605925:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.605935:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.605960:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05c371f800 10000000:01000000:3.0:1783967237.605965:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783967237.605969:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a04c34799c0 10000000:01000000:3.0:1783967237.605971:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783967237.605975:0:23394:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a04c34799c0 from 1 10000000:01000000:3.0:1783967237.605978:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783967237.606005:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.606013:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.606022:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.606050:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967237.606088:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.606116:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.606143:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018304 00000100:00100000:2.0:1783967237.606149:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018304 00000100:00100000:2.0:1783967237.606187:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783967237.606208:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+12:23394:x1870624588018304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967237.606217:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967237.606231:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630000/0x9269c8b31606892e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068927 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.606253:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630000/0x9269c8b31606892e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068927 expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.606263:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630000/0x9269c8b31606892e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068927 expref: 13 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.606272:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630000, rc 0) 00000100:00100000:2.0:1783967237.606312:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+13:23394:x1870624588018304:12345-0@lo:101:mount.lustre.0 Request processed in 118us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.606318:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783967237.608464:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967237.608494:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606892e expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.608505:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606892e expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.608530:0:23394:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783967237.608549:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606892e expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.608557:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179a00/0x9269c8b316068927 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606892e expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.608567:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a05c371f800 10000000:01000000:3.0:1783967237.608576:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783967237.608581:0:23394:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a05c371f800 from 1 10000000:01000000:3.0:1783967237.608584:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783967237.608614:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.609135:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.609154:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.609303:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967237.609425:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.609579:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.610751:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018432 00000100:00100000:2.0:1783967237.610950:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018432 00000100:00100000:2.0:1783967237.611080:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783967237.611090:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+13:23394:x1870624588018432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967237.611106:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967237.611122:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630800/0x9269c8b31606893c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068935 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.611149:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630800/0x9269c8b31606893c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068935 expref: 14 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.611173:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630800/0x9269c8b31606893c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068935 expref: 14 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.611182:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630800, rc 0) 00000100:00100000:2.0:1783967237.611267:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+14:23394:x1870624588018432:12345-0@lo:101:mount.lustre.0 Request processed in 179us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.611274:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783967237.611387:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967237.611413:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606893c expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.611423:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606893c expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.611450:0:23394:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783967237.611467:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606893c expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.611475:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179800/0x9269c8b316068935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606893c expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.611483:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1783967237.611488:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783967237.611494:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a05c371f800 10000000:01000000:3.0:1783967237.611497:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783967237.611500:0:23394:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1783967237.611503:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1783967237.611525:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.611531:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.611548:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.611564:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967237.611595:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.621765:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0013c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967237.622015:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018560 00000100:00100000:0.0:1783967237.622024:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018560 00000100:00100000:0.0:1783967237.622083:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783967237.622093:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+14:23394:x1870624588018560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967237.622110:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967237.622129:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602051a00/0x9269c8b31606894a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068943 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.622160:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602051a00/0x9269c8b31606894a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068943 expref: 15 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.622171:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602051a00/0x9269c8b31606894a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068943 expref: 15 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.622180:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051a00, rc 0) 00000100:00100000:0.0:1783967237.622276:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018560:12345-0@lo:101:mount.lustre.0 Request processed in 185us (10680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.622284:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783967237.625666:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967237.625710:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606894a expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.625725:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b31606894a expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967237.629271:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1783967237.632514:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967237.647490:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1783967237.647542:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1783967237.647555:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1783967237.647565:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1783967237.647576:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1783967237.647587:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1783967237.647599:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1783967237.647610:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1783967237.647621:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1783967237.647631:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1783967237.647642:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1783967237.647653:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1783967237.647664:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1783967237.647674:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1783967237.647684:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1783967237.647695:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1783967237.647706:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1783967237.647717:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1783967237.647728:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1783967237.647745:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1783967237.647760:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1783967237.651328:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1783967237.651388:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1783967237.651424:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1783967237.651438:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1783967237.651451:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1783967237.651462:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1783967237.651474:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1783967237.651486:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1783967237.651499:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1783967237.651514:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1783967237.651528:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1783967237.651543:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1783967237.651561:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1783967237.651576:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1783967237.651590:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1783967237.651604:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1783967237.651618:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1783967237.651633:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1783967237.651649:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1783967237.651662:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1783967237.651675:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1783967237.651689:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1783967237.651702:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1783967237.651735:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1783967237.651741:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1783967237.651876:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967237.651943:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967237.651981:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967237.652095:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018688 00000100:00100000:0.0:1783967237.652103:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018688 00000100:00100000:0.0:1783967237.652154:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783967237.652163:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967237.652333:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018688:12345-0@lo:501:mount.lustre.0 Request processed in 171us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.652342:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783967237.652677:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967237.652713:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967237.652760:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.652813:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967237.652967:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018816 00000100:00100000:1.0:1783967237.652973:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018816 00000100:00100000:1.0:1783967237.653008:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783967237.653016:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967237.653757:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018816:12345-0@lo:503:mount.lustre.0 Request processed in 740us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967237.653792:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783967237.653913:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018816:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783967237.654381:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967237.654463:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967237.654506:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.654539:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c2d4bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.654715:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588018944 00000100:00100000:2.0:1783967237.654720:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588018944 00000100:00100000:2.0:1783967237.654755:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783967237.654762:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967237.656066:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588018944:12345-0@lo:502:mount.lustre.0 Request processed in 1299us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.656086:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783967237.656215:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588018944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967237.656423:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1783967237.656456:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1783967237.656471:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1783967237.656486:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1783967237.656498:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1783967237.656511:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1783967237.656521:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1783967237.656531:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1783967237.656541:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1783967237.656551:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1783967237.656562:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1783967237.656572:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1783967237.656581:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1783967237.656591:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1783967237.656601:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1783967237.656612:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1783967237.656622:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1783967237.656633:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1783967237.656643:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1783967237.656652:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1783967237.656662:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1783967237.656673:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1783967237.656684:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1783967237.656695:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1783967237.656721:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1783967237.656733:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1783967237.656743:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1783967237.656754:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1783967237.656764:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1783967237.657241:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1783967237.657260:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1783967237.657272:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1783967237.657300:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1783967237.657314:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1783967237.657327:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1783967237.657339:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1783967237.657352:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1783967237.657364:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1783967237.657378:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1783967237.657392:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1783967237.657405:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1783967237.657418:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1783967237.657431:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1783967237.657444:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1783967237.657489:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588019072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967237.657550:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.657595:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef0013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.657670:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588019072 00000100:00100000:2.0:1783967237.657677:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588019072 00000100:00100000:2.0:1783967237.657728:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783967237.657737:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588019072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967237.657984:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588019072:12345-0@lo:502:mount.lustre.0 Request processed in 247us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.657992:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783967237.658510:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588019072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967237.658569:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1783967237.658581:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1783967237.665128:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967237.665143:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.665146:0:23398:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783967237.665154:0:23398:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1783967237.665158:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967237.665174:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a04c31419c0) 00000020:00000080:1.0:1783967237.665208:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1783967237.665229:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783967237.665303:0:23398:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783967237.665311:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068958 00000020:00000080:1.0:1783967237.665514:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1783967237.665519:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.665522:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.665524:0:23398:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1783967237.665527:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967237.665530:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.665531:0:23398:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1783967237.665534:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967237.665541:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a04c3140000) 00000020:00000080:1.0:1783967237.665551:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1783967237.665554:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783967237.665556:0:23398:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1783967237.665559:0:23398:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1783967237.665565:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783967237.665621:0:23398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05c371f800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1783967237.665632:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a04c3143380) 00000020:00000080:1.0:1783967237.665640:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1783967237.665695:0:23398:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783967237.665707:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b31606896d 00000020:00000080:1.0:1783967237.669080:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1783967237.669096:0:23398:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783967237.669106:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9269c8b316068974 00080000:01000000:1.0:1783967237.669116:0:23398:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783967237.669120:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b31606897b 00010000:00010000:2.0:1783967237.687022:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967237.843720:0:23398:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1783967237.846197:0:23398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1783967237.849993:0:23398:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783967237.855356:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1783967237.855371:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.855382:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.855397:0:23398:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1783967237.855401:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967237.855407:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.855409:0:23398:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1783967237.855411:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783967237.855417:0:23398:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:00000080:1.0:1783967237.855442:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967237.855471:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a05f671b380) 00000020:00000080:1.0:1783967237.855495:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1783967237.855501:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783967237.855570:0:23398:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1783967237.855576:0:23398:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783967237.855584:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b316068989 00010000:00080000:1.0:1783967237.855623:0:23398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f4e7e800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783967237.857303:0:23398:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1783967237.887082:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783967237.887100:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1783967237.887147:0:23398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783967237.887170:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316068990 00000100:00080000:1.0:1783967237.887180:0:23398:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783967237.887197:0:23398:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a05f4e7e800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967237.887235:0:23398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f10700 x1870624588019200/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967237.887263:0:23398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783967237.887313:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783967237.887317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1783967237.887319:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967237.887323:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 710 00000100:00080000:1.0:1783967237.887327:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783967237.887342:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c375a800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967237.887357:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f12680 x1870624588019456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967237.887367:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967237.887370:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967237.887373:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967237.887376:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967237.887415:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588019328:0@lo:400:kworker.0 00000100:00100000:1.0:1783967237.887482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967237.887534:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588019584:0@lo:400:kworker.0 00000100:00100000:1.0:1783967237.887580:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967237.887616:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588019328 00000100:00100000:1.0:1783967237.887623:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588019328 00000100:00100000:1.0:1783967237.887662:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783967237.887670:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+15:3646:x1870624588019328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967237.887715:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+15:3646:x1870624588019328:12345-0@lo:400:kworker.0 Request processed in 45us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967237.887726:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783967237.887754:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588019584 00000100:00100000:1.0:1783967237.887758:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588019584 00000100:00100000:1.0:1783967237.887812:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967237.887818:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588019584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967237.887853:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588019584:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967237.887867:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783967237.887906:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a04c1f13b80 x1870624588019584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967237.887919:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588019584:0@lo:400:kworker.0 00000100:00100000:1.0:1783967237.887944:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588019328:0@lo:400:kworker.0 00000020:01000000:1.0:1783967237.887991:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.887996:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.887998:0:23398:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1783967237.888001:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783967237.888003:0:23398:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783967237.888005:0:23398:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967237.888006:0:23398:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967237.888008:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783967237.888010:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.888011:0:23398:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783967237.888014:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967237.888018:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.888020:0:23398:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1783967237.888023:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783967237.888059:0:23398:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783967237.888074:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.888077:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.888079:0:23398:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1783967237.888081:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783967237.888083:0:23398:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1783967237.888084:0:23398:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967237.888086:0:23398:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967237.888087:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783967237.888089:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.888091:0:23398:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783967237.888099:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783967237.888102:0:23398:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783967237.888106:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.888107:0:23398:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783967237.888110:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783967237.888114:0:23398:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1783967237.888135:0:23398:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783967237.888138:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967237.888151:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a05f671cd40) 00000020:00000080:1.0:1783967237.888165:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783967237.888170:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783967237.888235:0:23398:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1783967237.888242:0:23398:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783967237.888249:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b31606899e 00010000:00080000:1.0:1783967237.888278:0:23398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f1a13800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783967237.888483:0:23398:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1783967237.888867:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588019200:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783967237.888912:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.888943:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588019456:0@lo:38:kworker.0 00000100:00100000:3.0:1783967237.888964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.888999:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588019200 00000100:00100000:3.0:1783967237.889005:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588019200 00000100:00100000:3.0:1783967237.889019:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588019456 00000100:00100000:3.0:1783967237.889021:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588019456 00000100:00100000:3.0:1783967237.889032:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783967237.889037:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588019200:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783967237.889056:0:22667:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 714 last 0 00000020:00000080:3.0:1783967237.889089:0:22667:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b3160689a5 00000004:00100000:3.0:1783967237.889103:0:22667:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783967237.889108:0:22667:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:1.0:1783967237.897841:0:23398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783967237.902269:0:23398:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1783967237.902743:0:22667:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a11000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967237.903038:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624588019200:12345-0@lo:38:llog_process_th.0 Request processed in 13996us (14121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967237.903054:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967237.903084:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783967237.903091:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588019456:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1783967237.903135:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1870624588019456:12345-0@lo:38:kworker.0 Request processed in 43us (14168us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783967237.903141:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783967237.903197:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783967237.903207:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1783967237.903217:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783967237.903231:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783967237.903234:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4e7e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783967237.903247:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588019200:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783967237.903261:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783967237.903265:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967237.903269:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783967237.903272:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588019456:0@lo:38:kworker.0 00000100:00100000:0.0:1783967237.904862:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588019712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967237.904946:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967237.904997:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588019712 00000100:00100000:0.0:1783967237.905005:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588019712 00000100:00100000:0.0:1783967237.905053:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967237.905062:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588019712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967237.905103:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783967237.905144:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588019712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.905152:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967237.905217:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588019712:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1783967237.906181:0:23398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967237.907087:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1783967237.907373:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1783967237.909321:0:23403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783967237.909327:0:23403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783967237.910057:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783967237.910070:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783967237.910110:0:23398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783967237.910133:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b3160689ac 00000100:00080000:1.0:1783967237.910147:0:23398:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783967237.910153:0:23398:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a05f1a13800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967237.910210:0:23398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f12680 x1870624588019840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967237.910235:0:23398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783967237.910269:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967237.910273:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967237.910276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967237.910278:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783967237.910416:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588019840:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783967237.910469:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588019840 offset 0 length 520: 4 00000020:01000000:1.0:1783967237.910536:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.910541:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.910543:0:23398:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783967237.910546:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783967237.910549:0:23398:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1783967237.910550:0:23398:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967237.910552:0:23398:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967237.910553:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783967237.910555:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.910557:0:23398:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783967237.910559:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783967237.910563:0:23398:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1783967237.910566:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.910567:0:23398:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783967237.910570:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783967237.910574:0:23398:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.159@tcp to nid 0x20000c0a8cc9f (192.168.204.159@tcp) 00000020:01000000:1.0:1783967237.910594:0:23398:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1783967237.910596:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783967237.910606:0:23398:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a05f67199c0) 00000020:00000080:1.0:1783967237.910619:0:23398:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1783967237.910623:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783967237.910691:0:23398:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1783967237.910698:0:23398:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783967237.910704:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9269c8b3160689ba 00010000:00080000:1.0:1783967237.910732:0:23398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f1a17000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:1.0:1783967237.910960:0:23398:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1783967237.911025:0:23398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783967237.911041:0:23398:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1783967237.920995:0:23398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783967237.924615:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1783967237.924829:0:23398:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:3.0:1783967237.926466:0:23405:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783967237.926473:0:23405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783967237.930443:0:23398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1783967237.930465:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783967237.930507:0:23398:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783967237.930529:0:23398:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b3160689c1 00000100:00080000:1.0:1783967237.930541:0:23398:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783967237.930547:0:23398:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967237.930585:0:23398:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f10700 x1870624588019968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967237.930617:0:23398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783967237.930684:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.930688:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.930690:0:23398:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783967237.930693:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967237.930697:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.930698:0:23398:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783967237.930701:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783967237.930703:0:23398:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783967237.930705:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.930707:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.930709:0:23398:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783967237.930711:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967237.930713:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.930714:0:23398:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783967237.930718:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783967237.930754:0:23398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967237.930758:0:23398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967237.930759:0:23398:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783967237.930763:0:23398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00100000:0.0:1783967237.930807:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588019968:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783967237.930869:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588019968 offset 0 length 520: 4 00000020:01000000:3.0:1783967237.930983:0:23394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1783967237.931019:0:23394:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1783967237.931039:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606894a expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.931049:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179000/0x9269c8b316068943 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606894a expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.931057:0:23394:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c371f800 from 1 10000000:01000000:3.0:1783967237.931060:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783967237.931086:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.931094:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.931106:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.931122:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967237.931161:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.931194:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11240 going to sleep for 11 seconds 00000100:00080000:2.0:1783967237.931255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967237.931260:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967237.931262:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967237.931265:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967237.931414:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020096 00000100:00100000:1.0:1783967237.931421:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020096 00000100:00100000:1.0:1783967237.931473:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967237.931483:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+15:23394:x1870624588020096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967237.931508:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967237.931520:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160689c8 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967237.931544:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967237.931554:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 16 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967237.931563:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1400, rc 0) 00000100:00100000:1.0:1783967237.931612:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+16:23394:x1870624588020096:12345-0@lo:101:mount.lustre.0 Request processed in 130us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967237.931619:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783967237.931751:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967237.931794:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.931811:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.932358:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020224:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783967237.932398:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.932424:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11240 going to sleep for 11 seconds 00000100:00100000:0.0:1783967237.932557:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020224 00000100:00100000:0.0:1783967237.932563:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020224 00000100:00100000:0.0:1783967237.932609:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783967237.932618:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+16:23394:x1870624588020224:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1783967237.932635:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1783967237.932653:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783967237.932656:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1783967237.932745:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+16:23394:x1870624588020224:12345-0@lo:256:mount.lustre.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.932753:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783967237.932879:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020224:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783967237.933521:0:23394:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783967237.933544:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.933553:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967237.933561:0:23394:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05c371f800 from 1 10000000:01000000:3.0:1783967237.933563:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783967237.933586:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.933592:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.933599:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967237.933613:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967237.933647:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.933741:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11240 going to sleep for 11 seconds 00000100:00100000:0.0:1783967237.938060:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020352 00000100:00100000:0.0:1783967237.938074:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020352 00000100:00100000:0.0:1783967237.938144:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967237.938155:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+16:23394:x1870624588020352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967237.938172:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967237.938203:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160689d6 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.938233:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.938245:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.938254:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051000, rc 0) 00000100:00100000:0.0:1783967237.938338:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020352:12345-0@lo:101:mount.lustre.0 Request processed in 185us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.938346:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783967237.938472:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967237.938494:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.938503:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967237.944625:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1783967237.945016:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967237.945220:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783967237.945259:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1783967237.945276:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1783967237.945292:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1783967237.945307:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1783967237.945323:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1783967237.945337:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1783967237.945351:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1783967237.945365:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783967237.945379:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1783967237.945394:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1783967237.945412:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1783967237.945417:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1783967237.945495:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967237.945567:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.945615:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.945798:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020480 00000100:00100000:2.0:1783967237.945807:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020480 00000100:00100000:2.0:1783967237.945862:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783967237.945872:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967237.945989:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020480:12345-0@lo:501:mount.lustre.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.945996:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783967237.946195:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967237.946233:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967237.946272:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967237.946307:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967237.946339:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020608 00000100:00100000:1.0:1783967237.946343:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020608 00000100:00100000:1.0:1783967237.946383:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783967237.946390:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967237.946475:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020608:12345-0@lo:503:mount.lustre.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967237.946481:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783967237.949395:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783967237.950353:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783967237.950447:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967237.950527:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967237.950568:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231000 going to sleep for 11 seconds 00000100:00100000:0.0:1783967237.954001:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020736 00000100:00100000:0.0:1783967237.954017:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020736 00000100:00100000:0.0:1783967237.954092:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783967237.954102:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967237.954337:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020736:12345-0@lo:502:mount.lustre.0 Request processed in 236us (3809us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.954346:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783967237.960038:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967237.960337:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783967237.960371:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1783967237.960388:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1783967237.960404:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1783967237.960416:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1783967237.960431:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1783967237.960445:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1783967237.960460:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1783967237.960473:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783967237.960505:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1783967237.960523:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1783967237.960564:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967237.960638:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967237.962230:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11240 going to sleep for 11 seconds 00000100:00100000:2.0:1783967237.967164:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020864 00000100:00100000:2.0:1783967237.967179:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020864 00000100:00100000:2.0:1783967237.967248:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783967237.967259:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967237.967452:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020864:12345-0@lo:502:mount.lustre.0 Request processed in 194us (6813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967237.967460:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783967237.967507:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783967237.967605:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1783967237.967619:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783967237.974607:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967237.974622:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974624:0:23407:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783967237.974633:0:23407:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05c371f800 00000020:00000080:0.0:1783967237.974636:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967237.974646:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967237.974648:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974649:0:23407:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783967237.974652:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967237.974655:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974656:0:23407:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783967237.974660:0:23407:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05c371f800 00000020:00000080:0.0:1783967237.974662:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967237.974727:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967237.974731:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974733:0:23407:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783967237.974736:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967237.974738:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974739:0:23407:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783967237.974743:0:23407:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05c371f800 00000020:00000080:0.0:1783967237.974744:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967237.974761:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967237.974764:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974765:0:23407:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783967237.974794:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967237.974804:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974805:0:23407:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1783967237.974810:0:23407:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05c371f800 00000020:00000080:0.0:1783967237.974812:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967237.974837:0:23407:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967237.974840:0:23407:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967237.974841:0:23407:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1783967237.974844:0:23407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1783967237.974963:0:23394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783967237.975002:0:23394:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783967237.975029:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.975042:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967237.975093:0:23394:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783967237.975096:0:23394:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05c371f800 10000000:01000000:2.0:1783967237.975099:0:23394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05c371f800 10000000:01000000:2.0:1783967237.975103:0:23394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783967237.975109:0:23394:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05c371f800 from 1 10000000:01000000:2.0:1783967237.975111:0:23394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783967237.975148:0:23394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.975156:0:23394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967237.975167:0:23394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967237.975214:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783967237.975281:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967237.975973:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed2316c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967237.985303:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588020992 00000100:00100000:3.0:1783967237.985319:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588020992 00000100:00100000:0.0:1783967237.992409:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783967237.992425:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:23394:x1870624588020992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967237.992443:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967237.992463:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602051400/0x9269c8b3160689eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b3160689e4 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.992495:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602051400/0x9269c8b3160689eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b3160689e4 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.992506:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602051400/0x9269c8b3160689eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160689e4 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967237.992516:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602051400, rc 0) 00000100:00100000:0.0:1783967237.992609:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588020992:12345-0@lo:101:mount.lustre.0 Request processed in 188us (17327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967237.992615:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783967237.992706:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588020992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967237.992727:0:23394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689eb expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967237.992737:0:23394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b3160689eb expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967237.998692:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1783967237.999067:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967237.999261:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1783967237.999286:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1783967237.999310:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1783967237.999322:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1783967237.999336:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1783967237.999350:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1783967237.999364:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1783967237.999378:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1783967237.999392:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1783967237.999405:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1783967237.999418:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1783967237.999447:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1783967237.999462:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1783967237.999473:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1783967237.999485:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1783967237.999497:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1783967237.999509:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1783967237.999521:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1783967237.999532:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1783967237.999543:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1783967237.999558:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1783967237.999570:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1783967237.999582:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1783967237.999594:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1783967237.999605:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1783967237.999616:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1783967237.999628:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1783967237.999652:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1783967237.999668:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1783967237.999680:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1783967237.999691:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1783967237.999702:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1783967237.999714:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1783967237.999725:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1783967237.999736:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1783967237.999760:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1783967237.999792:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1783967237.999808:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1783967237.999823:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1783967237.999836:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1783967237.999848:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1783967237.999859:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1783967237.999871:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1783967237.999897:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1783967237.999913:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1783967237.999928:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1783967237.999940:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1783967237.999953:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1783967238.000048:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1783967238.000066:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1783967238.000081:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1783967238.000085:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1783967238.000168:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967238.000248:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967238.000292:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783967238.003657:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021120 00000100:00100000:0.0:1783967238.003674:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021120 00000100:00100000:0.0:1783967238.003746:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783967238.003757:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967238.003966:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021120:12345-0@lo:501:mount.lustre.0 Request processed in 209us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.003992:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783967238.005220:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967238.005285:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967238.005338:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967238.009400:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783967238.018504:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021248 00000100:00100000:0.0:1783967238.018522:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021248 00000100:00100000:0.0:1783967238.018677:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967238.018687:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967238.018921:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021248:12345-0@lo:503:mount.lustre.0 Request processed in 235us (13581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.018930:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967238.019022:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021248:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783967238.019479:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783967238.019562:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967238.019607:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.019645:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9000 going to sleep for 11 seconds 00000100:00100000:0.0:1783967238.019661:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021376 00000100:00100000:0.0:1783967238.019666:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021376 00000100:00100000:0.0:1783967238.019694:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783967238.019701:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967238.019822:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021376:12345-0@lo:502:mount.lustre.0 Request processed in 120us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.019829:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783967238.019869:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967238.020055:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1783967238.020082:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1783967238.020097:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1783967238.020110:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1783967238.020134:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1783967238.020148:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1783967238.020161:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1783967238.020202:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1783967238.020219:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1783967238.020233:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1783967238.020245:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1783967238.020257:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1783967238.020270:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1783967238.020282:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1783967238.020295:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1783967238.020308:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1783967238.020320:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1783967238.020331:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1783967238.020344:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1783967238.020357:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1783967238.020370:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1783967238.020384:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1783967238.020398:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1783967238.020426:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1783967238.020441:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1783967238.020453:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1783967238.020467:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1783967238.020479:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1783967238.020492:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1783967238.020506:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1783967238.020519:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1783967238.020532:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1783967238.020546:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1783967238.020558:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1783967238.020572:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1783967238.020586:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1783967238.020599:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1783967238.020623:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1783967238.020637:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1783967238.020664:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1783967238.020679:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1783967238.020692:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1783967238.020705:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1783967238.020719:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1783967238.020733:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1783967238.020747:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1783967238.020760:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1783967238.020800:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1783967238.020835:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021504:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967238.020874:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.020899:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783967238.020917:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021504 00000100:00100000:0.0:1783967238.020921:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021504 00000100:00100000:0.0:1783967238.020942:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783967238.020948:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967238.021024:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021504:12345-0@lo:502:mount.lustre.0 Request processed in 75us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.021031:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783967238.021070:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967238.027025:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1783967238.027112:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1783967238.027170:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967238.027275:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.027313:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783967238.027362:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021632 00000100:00100000:0.0:1783967238.027376:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021632 00000100:00100000:3.0:1783967238.027507:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783967238.027521:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967238.027654:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021632:12345-0@lo:502:mount.lustre.0 Request processed in 137us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967238.027673:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967238.029996:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967238.030101:0:23394:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1783967238.030115:0:23394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1783967238.031149:0:23412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1783967238.031164:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a05c34c8000) 00000020:00000080:0.0:1783967238.031200:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1783967238.031359:0:23412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05c371f800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783967238.031364:0:23412:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05c371f800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1783967238.031366:0:23412:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05c371f800 3 00010000:00080000:0.0:1783967238.031408:0:23412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a05f4cf7000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.159@tcp at head 00010000:00010000:0.0:1783967238.043349:0:23412:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1783967238.043463:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1783967238.043507:0:23412:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783967238.043519:0:23412:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9269c8b3160689f9 00000100:00080000:0.0:1783967238.043531:0:23412:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783967238.043537:0:23412:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a05f4cf7000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967238.043592:0:23412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee129180 x1870624588021760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967238.043636:0:23412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783967238.043824:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624588021760:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967238.043902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783967238.044474:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967238.044479:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967238.044482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967238.044484:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967238.044891:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021760 00000100:00100000:3.0:1783967238.044900:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021760 00000100:00100000:3.0:1783967238.044938:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783967238.044947:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1870624588021760:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1783967238.044976:0:22664:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 714 last 0 00000020:00000080:3.0:1783967238.045010:0:22664:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9269c8b316068a00 00000004:00100000:3.0:1783967238.045026:0:22664:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783967238.045058:0:22664:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f69000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967238.045134:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1870624588021760:12345-0@lo:38:llog_process_th.0 Request processed in 188us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967238.045142:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783967238.045198:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05ee129180 x1870624588021760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967238.045210:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783967238.045217:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1783967238.045224:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783967238.045229:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783967238.045231:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f4cf7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783967238.045236:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1870624588021760:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783967238.047018:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1783967238.047083:0:23394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783967238.047120:0:23394:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783967238.047136:0:23394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689eb expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.047147:0:23394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631a00/0x9269c8b3160689e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b3160689eb expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783967238.047220:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783967238.047222:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783967238.047224:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967238.047225:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967238.047226:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967238.047228:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967238.047229:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967238.047231:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967238.047232:0:23394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783967238.047237:0:23394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1783967238.047239:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783967238.047240:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1783967238.047241:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967238.047242:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967238.047243:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967238.047244:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967238.047246:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783967238.047247:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967238.047248:0:23394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783967238.047270:0:23394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1783967238.047288:0:23394:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021888:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783967238.047350:0:23394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.047381:0:23394:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967238.048952:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588021888 00000100:00100000:3.0:1783967238.048963:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588021888 00000100:00100000:3.0:1783967238.049015:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783967238.049026:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:23394:x1870624588021888:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783967238.049056:0:22656:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783967238.049071:0:22656:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1783967238.062035:0:22642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1783967238.062095:0:22656:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783967238.062112:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1783967238.062383:0:22678:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783967238.062388:0:22678:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783967238.062415:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062436:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068904 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062443:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062464:0:22678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062506:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062520:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 18 pid: 22656 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967238.062535:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588022016:0@lo:104: 00000100:00100000:0.0:1783967238.062599:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783967238.062651:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068904 expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062659:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068904 expref: 18 pid: 22655 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967238.062668:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588022144:0@lo:104: 00000100:00100000:0.0:1783967238.062687:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.062702:0:22678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783967238.062723:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022016 00000100:00100000:0.0:1783967238.062730:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022016 00000100:00100000:0.0:1783967238.062795:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022144 00000100:00100000:0.0:1783967238.062799:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022144 00000100:00100000:0.0:1783967238.062814:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967238.062822:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+4:22678:x1870624588022016:12345-0@lo:104: 00010000:00010000:0.0:1783967238.062834:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062914:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783967238.062920:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+4:22678:x1870624588022016:12345-0@lo:104: Request processed in 99us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.062928:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967238.062944:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967238.062949:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588022144:12345-0@lo:104: 00010000:00010000:0.0:1783967238.062956:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.062987:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783967238.062992:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588022144:12345-0@lo:104: Request processed in 43us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.062998:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783967238.063013:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967238.063019:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063027:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179e00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967238.063031:0:22651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063040:0:22651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967238.063047:0:22651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967238.063053:0:22651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1783967238.063062:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588022016:0@lo:104: 00000100:00100000:1.0:1783967238.063078:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588022144:0@lo:104: 00010000:00010000:0.0:1783967238.063085:0:22651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063091:0:22651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967238.063097:0:22678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063115:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063122:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602179e00/0x9269c8b3160689c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160689cf expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063137:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967238.063140:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063146:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:0.0:1783967238.063149:0:22651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063156:0:22651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783967238.063162:0:22651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967238.063168:0:22651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783967238.063179:0:22651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063197:0:22651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783967238.063203:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063218:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b31606890b expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063229:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967238.063230:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967238.063232:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967238.063251:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588022272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967238.063278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.063315:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783967238.063321:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588022400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967238.063341:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967238.063376:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022272 00000100:00100000:0.0:1783967238.063380:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022272 00010000:00010000:0.0:1783967238.063395:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 19 pid: 22656 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967238.063415:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022400 00000100:00100000:0.0:1783967238.063418:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022400 00010000:00010000:0.0:1783967238.063426:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068904 expref: 20 pid: 22655 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967238.063439:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967238.063445:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+20:3645:x1870624588022272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967238.063455:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967238.063460:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 20 pid: 22656 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063470:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 20 pid: 22656 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063488:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1400/0x9269c8b3160689cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160689c8 expref: 20 pid: 22656 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063499:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967238.063526:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+19:3645:x1870624588022272:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.063532:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967238.063545:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967238.063551:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+18:3645:x1870624588022400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967238.063559:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967238.063563:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068904 expref: 18 pid: 22655 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063572:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068904 expref: 18 pid: 22655 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063582:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050600/0x9269c8b31606890b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068904 expref: 18 pid: 22655 timeout: 814 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063592:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063599:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783967238.063610:0:22648:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002479094s 00010000:00010000:0.0:1783967238.063614:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063629:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063636:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063643:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063649:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967238.063654:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063661:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063674:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063684:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967238.063707:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+17:3645:x1870624588022400:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.063714:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967238.063738:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588022400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967238.063746:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588022272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967238.063762:0:22678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063789:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967238.063801:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050200/0x9269c8b316068a07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967238.064017:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967238.064104:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+16:23394:x1870624588021888:12345-0@lo:253:mount.lustre.0 Request processed in 15081us (16754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967238.064112:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783967238.064231:0:23394:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:23394:1870624588021888:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783967238.064242:0:23394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1783967238.064245:0:23394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783967238.064246:0:23394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1783967238.064248:0:23394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783967238.064249:0:23394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783967238.064250:0:23394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783967238.064251:0:23394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783967238.064252:0:23394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783967238.064254:0:23394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783967238.064255:0:23394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783967238.064269:0:23394:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1783967238.078527:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1783967238.078660:0:23419:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1783967238.078665:0:23419:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1783967238.080039:0:23420:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783967238.080056:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1783967238.080593:0:23420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967238.088555:0:23420:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:3.0:1783967238.090420:0:23421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23421:1870624588022528:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.090491:0:23421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967238.090525:0:23421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11240 going to sleep for 11 seconds 00000100:00100000:3.0:1783967238.093996:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022528 00000100:00100000:3.0:1783967238.094017:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022528 00000100:00100000:3.0:1783967238.094095:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967238.094106:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23421:x1870624588022528:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.094248:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23421:x1870624588022528:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 144us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967238.094255:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967238.094308:0:23421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23421:1870624588022528:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1783967238.094354:0:23421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783967238.094399:0:23421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23421:1870624588022656:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.094443:0:23421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967238.094468:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022656 00000100:00100000:3.0:1783967238.094487:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022656 00000100:00100000:3.0:1783967238.094506:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967238.094512:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23421:x1870624588022656:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.094609:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23421:x1870624588022656:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967238.094615:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967238.094634:0:23421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11240 going to sleep for 11 seconds 00000100:00100000:3.0:1783967238.094648:0:23421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23421:1870624588022656:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.094709:0:23421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23421:1870624588022784:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.094734:0:23421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967238.094751:0:23421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967238.103550:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022784 00000100:00100000:2.0:1783967238.103565:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022784 00000100:00100000:2.0:1783967238.103631:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783967238.103642:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23421:x1870624588022784:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783967238.103758:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23421:x1870624588022784:12345-0@lo:900:lod0001_rec0000.0 Request processed in 117us (9022us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967238.103783:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783967238.103837:0:23421:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a05e77ead80 x1870624588022784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783967254 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967238.103853:0:23421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23421:1870624588022784:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1783967238.103934:0:23421:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23421:1870624588022912:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1783967238.103992:0:23421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967238.104023:0:23421:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231600 going to sleep for 11 seconds 00000040:01000000:1.0:1783967238.106584:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1783967238.106634:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783967238.107154:0:23394:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783967238.107162:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1783967238.107212:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967238.107901:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588022912 00000100:00100000:3.0:1783967238.107911:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588022912 00000100:00100000:3.0:1783967238.107963:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783967238.107973:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23421:x1870624588022912:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1783967238.108113:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23421:x1870624588022912:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 141us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967238.108121:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967238.108226:0:23421:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23421:1870624588022912:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1783967238.108285:0:23421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967238.110341:0:23421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783967238.110433:0:23421:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1783967238.113515:0:23394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783967238.115614:0:23394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783967238.115701:0:23394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1783967238.115864:0:23394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1783967238.125052:0:23420:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783967238.125063:0:23420:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1783967238.126645:0:23394:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1783967238.130800:0:23394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1783967238.136506:0:23394:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783967238.136547:0:23394:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb71ec145b988 00100000:10000000:1.0:1783967238.136556:0:23394:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1783967238.146513:0:23394:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783967238.146553:0:23394:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783967238.146573:0:23394:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783967238.146593:0:23394:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1783967238.149461:0:23394:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967238.149682:0:23394:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1783967238.327886:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783967238.711940:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967239.102250:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783967239.352966:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783967239.737312:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783967239.798833:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967239.798842:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c371f800 from 12 10000000:01000000:0.0:1783967239.798847:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967239.798889:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967239.798901:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967239.798923:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967239.798950:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967239.799013:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967239.799049:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967239.799185:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023040 00000100:00100000:2.0:1783967239.799193:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023040 00000100:00100000:2.0:1783967239.799232:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783967239.799241:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+16:22659:x1870624588023040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967239.799264:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967239.799278:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a0e expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967239.799310:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a0e expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967239.799321:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a0e expref: 17 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967239.799331:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631200, rc 0) 00000100:00100000:2.0:1783967239.799388:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588023040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967239.799395:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783967239.799508:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967239.799526:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967239.799536:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967239.799597:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783967239.799642:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967239.799665:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967239.801009:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023168 00000100:00100000:2.0:1783967239.801017:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023168 00000100:00100000:2.0:1783967239.801063:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783967239.801072:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588023168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783967239.801090:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783967239.801109:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783967239.801112:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1783967239.801219:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588023168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 147us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967239.801228:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783967239.801239:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783967239.801293:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783967239.801301:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967239.801311:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967239.801320:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783967239.801322:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a04c31ac800 from 12 10000000:01000000:3.0:1783967239.801325:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783967239.801345:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967239.801352:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967239.801359:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967239.801374:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967239.801400:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967239.801435:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967239.801484:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023296 00000100:00100000:2.0:1783967239.801505:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023296 00000100:00100000:2.0:1783967239.801534:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783967239.801540:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588023296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967239.801548:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967239.801560:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a1c expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967239.801577:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a1c expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967239.801586:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a1c expref: 18 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967239.801593:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631800, rc 0) 00000100:00100000:3.0:1783967239.801702:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967239.801718:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967239.801737:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967239.801804:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783967239.801844:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967239.801869:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1783967239.802052:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023424 00000100:00100000:0.0:1783967239.802057:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023424 00000100:00100000:0.0:1783967239.802099:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783967239.802106:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+19:22659:x1870624588023424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783967239.802116:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783967239.802127:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783967239.802130:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1783967239.802209:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+19:22659:x1870624588023424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967239.802216:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783967239.802228:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:22659:x1870624588023296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967239.802238:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783967239.802264:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588023424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783967239.802306:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783967239.802313:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967239.802321:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967240.120344:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783967240.374915:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783967240.759104:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783967241.274459:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783967241.398849:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:3.0:1783967241.782912:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967242.425686:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 0 seconds 00010000:00010000:0.0:1783967242.806882:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967243.127335:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783967243.127341:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1783967243.127345:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967243.127359:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a04c375a800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967243.127382:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77e8e00 x1870624588023680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967243.127400:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967243.127404:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967243.127407:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967243.127409:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967243.127516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967243.127519:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967243.127522:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967243.127538:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967243.127574:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588023808:0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.127646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.127684:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967243.127689:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588023552:0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.127716:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967243.129030:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023808 00000100:00100000:1.0:1783967243.129055:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023808 00000100:00100000:1.0:1783967243.129123:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967243.129133:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588023808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967243.129203:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588023808:12345-0@lo:400:kworker.0 Request processed in 71us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967243.129210:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783967243.129348:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05e77e8380 x1870624588023808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967243.129363:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588023808:0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.129397:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588023680:0@lo:38:kworker.0 00000100:00100000:3.0:1783967243.131871:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.131953:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588023936:0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.132002:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.132027:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783967243.132033:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588024064:0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.132056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.132100:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023552 00000100:00100000:3.0:1783967243.132107:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023552 00000100:00100000:3.0:1783967243.132156:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783967243.132164:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:3648:x1870624588023552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.132210:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:3648:x1870624588023552:12345-0@lo:400:kworker.0 Request processed in 47us (4492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967243.132217:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783967243.132249:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023680 00000100:00100000:3.0:1783967243.132266:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023680 00000100:00100000:3.0:1783967243.132279:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588023936 00000100:00100000:3.0:1783967243.132281:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588023936 00000100:00100000:3.0:1783967243.132300:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783967243.132304:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1870624588023680:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1783967243.132328:0:22668:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 719 last 0 00000020:00000080:3.0:1783967243.132361:0:22668:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316068a2a 00000004:00100000:3.0:1783967243.132377:0:22668:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1783967243.132384:0:22668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1783967243.132632:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024064 00000100:00100000:1.0:1783967243.132637:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024064 00000100:00100000:1.0:1783967243.132667:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967243.132674:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588024064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967243.132717:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588024064:12345-0@lo:400:kworker.0 Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967243.132723:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783967243.132859:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05e77eb800 x1870624588024064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967243.132873:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588024064:0@lo:400:kworker.0 00000100:00100000:3.0:1783967243.136280:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588023552:0@lo:400:kworker.0 00000100:00100000:2.0:1783967243.143578:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783967243.143607:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588024192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967243.143683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967243.144015:0:22667:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1783967243.144023:0:22667:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1783967243.144372:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024192 00000100:00100000:3.0:1783967243.144379:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024192 00000100:00100000:1.0:1783967243.144488:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967243.144498:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624588023936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967243.144611:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624588023936:12345-0@lo:400:kworker.0 Request processed in 115us (12607us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967243.144619:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967243.144636:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967243.144642:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588024192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967243.144677:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967243.144726:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588024192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967243.144742:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967243.144982:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588024192:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1783967243.146002:0:22668:0:(import.c:65:import_set_state_nolock()) ffff9a05f570b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967243.146100:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624588023680:12345-0@lo:38:kworker.0 Request processed in 13794us (14235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967243.146109:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783967243.146188:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588023936:0@lo:400:kworker.0 00000100:00080000:1.0:1783967243.146250:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1783967243.146260:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1783967243.146265:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1783967243.146268:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c375a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783967243.146322:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a07b455e): req@ffff9a05ee12a680 x1870624588016256/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967243.146346:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588023680:0@lo:38:kworker.0 00000100:00100000:3.0:1783967243.146426:0:22704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.146450:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9dcd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783967243.146487:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588016256 00000100:00100000:1.0:1783967243.146492:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588016256 00000100:00100000:1.0:1783967243.146525:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967243.146532:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22704:x1870624588016256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783967243.146598:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22704:x1870624588016256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967243.146604:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783967243.146652:0:22704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22704:1870624588016256:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1783967243.146681:0:22704:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1783967243.146719:0:22704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22704:1870624588024320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783967243.146899:0:22704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.146918:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967243.146927:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024320 00000100:00100000:3.0:1783967243.146929:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024320 00000100:00100000:3.0:1783967243.146944:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783967243.146948:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22704:x1870624588024320:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783967243.147021:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22704:x1870624588024320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967243.147032:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783967243.147048:0:22704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22704:1870624588024320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783967243.147109:0:22704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22704:1870624588024448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1783967243.147135:0:22704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.147144:0:22704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967243.147154:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024448 00000100:00100000:3.0:1783967243.147157:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024448 00000100:00100000:2.0:1783967243.147167:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588024576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967243.147174:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783967243.147179:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22704:x1870624588024448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1783967243.147191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967243.147227:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22704:x1870624588024448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967243.147234:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783967243.147254:0:22704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22704:1870624588024448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1783967243.147289:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024576 00000040:00080000:3.0:1783967243.147292:0:22704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783967243.147293:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024576 00000100:00100000:1.0:1783967243.147307:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783967243.147312:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588024576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783967243.147330:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967243.147372:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588024576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967243.147377:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783967243.147436:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588024576:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1783967243.149512:0:22704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783967243.149598:0:22704:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 24, retries 0 00000004:00080000:3.0:1783967243.149602:0:22704:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1783967243.836705:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783967243.863092:0:23665:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1783967244.150916:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967229/real 1783967229] req@ffff9a05fba45c00 x1870624588017280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967244.150971:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba45c00 x1870624588017280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967244.150981:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967229/real 1783967229] req@ffff9a05fba44e00 x1870624588017408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967244 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967244.150991:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba44e00 x1870624588017408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967244 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783967244.151015:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967244.151032:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967244.151037:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017280:0@lo:8:kworker.0 00000100:00080000:1.0:1783967244.151042:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967244.151049:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783967244.151052:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588017408:0@lo:8:kworker.0 00000100:00080000:2.0:1783967244.151150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967244.151156:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783967244.151160:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967244.151166:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:2.0:1783967244.151172:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783967244.151179:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a04c3cc2800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:2.0:1783967244.151199:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba47100 x1870624588024960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967244.151213:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588024704:0@lo:400:kworker.0 00000100:00080000:2.0:1783967244.151219:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967244.151224:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783967244.151225:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783967244.151228:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:2.0:1783967244.151231:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783967244.151234:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967244.151280:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588024960:0@lo:8:kworker.0 00000100:00100000:0.0:1783967244.151361:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588024832:0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.151711:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba44380 x1870624588025088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783967244.151753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967244.151757:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967244.151759:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967244.151762:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967244.151819:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588025216:0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.159475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967244.159549:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025216 00000100:00100000:2.0:1783967244.159558:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025216 00000100:00100000:2.0:1783967244.159615:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967244.159638:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588025216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.159702:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588025216:12345-0@lo:400:kworker.0 Request processed in 79us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967244.159709:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967244.159739:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588025344:0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.159794:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967244.159816:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967244.159848:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025344 00000100:00100000:2.0:1783967244.159853:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025344 00000100:00100000:1.0:1783967244.159866:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588025472:0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.159885:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967244.159894:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588025344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967244.159901:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967244.159933:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025472 00000100:00100000:1.0:1783967244.159937:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025472 00000100:00100000:2.0:1783967244.159946:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588025344:12345-0@lo:400:kworker.0 Request processed in 54us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967244.159955:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783967244.159966:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967244.159973:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588025472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.160001:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588025344:0@lo:400:kworker.0 00000100:00100000:1.0:1783967244.160003:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588025472:12345-0@lo:400:kworker.0 Request processed in 31us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967244.160013:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783967244.160046:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05fba44e00 x1870624588025216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967244.160059:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588025216:0@lo:400:kworker.0 00010000:00080000:1.0:1783967244.160062:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05fba45880 x1870624588025472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967244.160088:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588025472:0@lo:400:kworker.0 00000100:00100000:0.0:1783967244.160170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967244.160491:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024704 00000100:00100000:0.0:1783967244.160496:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024704 00000100:00100000:0.0:1783967244.160529:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783967244.160535:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:3645:x1870624588024704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967244.160576:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:3645:x1870624588024704:12345-0@lo:400:kworker.0 Request processed in 41us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967244.160583:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783967244.160620:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588024704:0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.161302:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588024832 00000100:00100000:2.0:1783967244.161308:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588024832 00000100:00100000:2.0:1783967244.161346:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967244.161353:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624588024832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967244.161424:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1870624588024832:12345-0@lo:400:kworker.0 Request processed in 71us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967244.161431:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783967244.161538:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588024832:0@lo:400:kworker.0 00000400:00000100:3.0:1783967244.162158:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588024960 offset 0 length 520: 4 00000100:00100000:3.0:1783967244.162228:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588025088:0@lo:8:kworker.0 00000400:00000100:3.0:1783967244.162270:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588025088 offset 0 length 520: 4 00010000:00010000:0.0:1783967244.856237:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783967245.014179:0:23717:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967245.018896:0:23717:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783967245.882357:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1783967246.615835:0:23768:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967246.616049:0:23768:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1783967246.902959:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967247.223224:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967237/real 1783967237] req@ffff9a04c1f10700 x1870624588019968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967247 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967247.223255:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c1f10700 x1870624588019968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967247 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967247.223265:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967237/real 1783967237] req@ffff9a04c1f12680 x1870624588019840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967247 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967247.223276:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c1f12680 x1870624588019840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967247 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783967247.223297:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967247.223319:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783967247.223323:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588019968:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783967247.223328:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a13800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967247.223333:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783967247.223335:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588019840:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783967247.223459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967247.223464:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967247.223466:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967247.223469:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967247.223483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967247.223486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783967247.223488:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a13800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967247.223493:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 714 00000100:00080000:1.0:1783967247.223499:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783967247.223506:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a05f1a13800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967247.223525:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f12a00 x1870624588026112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967247.223536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967247.223539:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967247.223540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967247.223543:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 714 00000100:00080000:1.0:1783967247.223546:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783967247.223548:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967247.223557:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c1f12d80 x1870624588026240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967247.223653:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588025600:0@lo:400:kworker.0 00000100:00100000:0.0:1783967247.223724:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967247.223795:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624588026368:0@lo:400:kworker.0 00000100:00100000:0.0:1783967247.223826:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967247.223848:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967247.223853:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588025984:0@lo:400:kworker.0 00000100:00100000:0.0:1783967247.223876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967247.223906:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588026368 00000100:00100000:0.0:1783967247.223913:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588026368 00000100:00100000:0.0:1783967247.223959:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967247.223967:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624588026368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967247.224034:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624588026368:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967247.224042:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967247.224067:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025984 00000100:00100000:0.0:1783967247.224071:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025984 00000100:00100000:0.0:1783967247.224096:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783967247.224103:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588025984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967247.224136:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588025984:12345-0@lo:400:kworker.0 Request processed in 34us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967247.224142:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783967247.224184:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588025984:0@lo:400:kworker.0 00010000:00080000:0.0:1783967247.224194:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c1f13480 x1870624588026368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967247.224203:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624588026368:0@lo:400:kworker.0 00000100:00100000:1.0:1783967247.224632:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025600 00000100:00100000:1.0:1783967247.224638:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025600 00000100:00100000:1.0:1783967247.224685:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783967247.224692:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:3646:x1870624588025600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967247.224733:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:3646:x1870624588025600:12345-0@lo:400:kworker.0 Request processed in 42us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967247.224740:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783967247.224790:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588025600:0@lo:400:kworker.0 00000100:00100000:2.0:1783967247.224863:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588025728:0@lo:400:kworker.0 00000100:00100000:2.0:1783967247.224892:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967247.224921:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783967247.224927:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588025856:0@lo:400:kworker.0 00000100:00100000:2.0:1783967247.224946:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967247.224974:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025856 00000100:00100000:2.0:1783967247.224987:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025856 00000100:00100000:2.0:1783967247.225022:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783967247.225029:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588025856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967247.225061:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588025856:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967247.225068:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783967247.225085:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588026112:0@lo:8:kworker.0 00000400:00000100:2.0:1783967247.225108:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588026112 offset 0 length 520: 4 00000100:00100000:2.0:1783967247.225120:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588026240:0@lo:8:kworker.0 00000400:00000100:2.0:1783967247.225138:0:3644:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870624588026240 offset 0 length 520: 4 00010000:00080000:2.0:1783967247.225165:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c1f10380 x1870624588025856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967247.225174:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588025856:0@lo:400:kworker.0 00000100:00100000:1.0:1783967247.225478:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588025728 00000100:00100000:1.0:1783967247.225483:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588025728 00000100:00100000:1.0:1783967247.225515:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783967247.225523:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624588025728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967247.225558:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1870624588025728:12345-0@lo:400:kworker.0 Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967247.225565:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783967247.227103:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588025728:0@lo:400:kworker.0 00010000:00010000:2.0:1783967247.928601:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967248.247004:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783967248.247032:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588026496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967248.247132:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967248.247207:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588026496 00000100:00100000:2.0:1783967248.247215:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588026496 00000100:00100000:2.0:1783967248.247267:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967248.247276:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588026496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967248.247320:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967248.247370:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588026496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967248.247393:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967248.247440:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588026496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967248.247638:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783967248.247648:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588026624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967248.247678:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967248.247745:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588026624 00000100:00100000:3.0:1783967248.247750:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588026624 00000100:00100000:3.0:1783967248.247812:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783967248.247820:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588026624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783967248.247837:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783967248.247874:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588026624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967248.247881:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783967248.247942:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588026624:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1783967248.351280:0:23816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc63485dc0 20000000:00000080:0.0:1783967248.351301:0:23816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05fd75ec00 uarg=0000000000000000 20000000:01000000:0.0:1783967248.351345:0:23816:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783967248.351352:0:23816:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783967248.351358:0:23816:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783967248.352743:0:23817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1783967248.353622:0:23816:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783967248.366864:0:23816:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783967248.367136:0:23816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.367158:0:23816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.367166:0:23816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.367187:0:23816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.367233:0:23816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.367249:0:23816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 17 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967248.367265:0:23816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1870624588026752:0@lo:104: 00000100:00100000:1.0:1783967248.367334:0:23816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783967248.367390:0:23816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.367399:0:23816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 17 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967248.367408:0:23816:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1870624588026880:0@lo:104: 00000100:00100000:1.0:1783967248.367441:0:23816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967248.367463:0:23816:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05fce970c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967248.367526:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588026752 00000100:00100000:2.0:1783967248.367533:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588026752 00000100:00100000:2.0:1783967248.367569:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588026880 00000100:00100000:2.0:1783967248.367572:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588026880 00000100:00100000:2.0:1783967248.367585:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967248.367593:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+4:23816:x1870624588026752:12345-0@lo:104: 00010000:00010000:2.0:1783967248.367607:0:22646:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367673:0:22646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783967248.367680:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+4:23816:x1870624588026752:12345-0@lo:104: Request processed in 87us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967248.367686:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967248.367703:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783967248.367710:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+3:23816:x1870624588026880:12345-0@lo:104: 00010000:00010000:2.0:1783967248.367716:0:22646:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367748:0:22646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783967248.367753:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+3:23816:x1870624588026880:12345-0@lo:104: Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967248.367758:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1783967248.367796:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783967248.367801:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367815:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967248.367819:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367827:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967248.367833:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967248.367839:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783967248.367865:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367871:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783967248.367891:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367898:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602179c00/0x9269c8b3160689d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160689dd expref: -99 pid: 23394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367912:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967248.367915:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367921:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050c00 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:2.0:1783967248.367924:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367941:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783967248.367947:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967248.367952:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783967248.367966:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367972:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783967248.367978:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.367985:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b3160688d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b3160688da expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368008:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967248.368010:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967248.368011:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967248.368025:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588027008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967248.368054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967248.368074:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783967248.368080:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588027136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967248.368100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967248.368127:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027008 00000100:00100000:2.0:1783967248.368132:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027008 00010000:00010000:2.0:1783967248.368149:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 18 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967248.368176:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027136 00000100:00100000:2.0:1783967248.368178:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027136 00010000:00010000:2.0:1783967248.368188:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 19 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967248.368200:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967248.368205:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+19:3645:x1870624588027008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967248.368215:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967248.368219:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 19 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368227:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 19 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368242:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967248.368267:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+19:3645:x1870624588027008:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967248.368274:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967248.368286:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783967248.368292:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+18:3645:x1870624588027136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967248.368300:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967248.368304:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 18 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368313:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 18 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368323:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368336:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368348:0:22647:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368356:0:22647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368362:0:22647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368369:0:22647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368374:0:22647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967248.368379:0:22647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368385:0:22647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368393:0:22647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967248.368403:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967248.368425:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+18:3645:x1870624588027136:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967248.368431:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783967248.368464:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588027136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967248.368480:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588027008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783967248.369133:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967248.369234:0:23816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602051000/0x9269c8b3160689dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160689d6 expref: 17 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967248.369247:0:23816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1870624588026752:0@lo:104: 00010000:00010000:1.0:1783967248.369256:0:23816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602179400/0x9269c8b3160688da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b3160688d3 expref: 16 pid: 22657 timeout: 824 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967248.369265:0:23816:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23816:1870624588026880:0@lo:104: 00010000:00010000:1.0:1783967248.369290:0:23816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.369299:0:23816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.369305:0:23816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967248.369312:0:23816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1e00/0x9269c8b316068a31 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1783967248.764095:0:23395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1783967248.958807:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783967249.656234:0:22659:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783967249.656247:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05c371f800 from 13 10000000:01000000:0.0:1783967249.656254:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967249.656330:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.656371:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.656387:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967249.656421:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967249.656524:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967249.656592:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967249.658171:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027264 00000100:00100000:1.0:1783967249.658192:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027264 00000100:00100000:1.0:1783967249.658304:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783967249.658317:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+16:22659:x1870624588027264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967249.658341:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967249.658366:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a38 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967249.658404:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a38 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967249.658418:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a38 expref: 17 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967249.658430:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1600, rc 0) 00000100:00100000:1.0:1783967249.658538:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588027264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967249.658570:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783967249.659393:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967249.659423:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.659438:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967249.659553:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967249.659612:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967249.659681:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967249.659818:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027392 00000100:00100000:3.0:1783967249.659825:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027392 00000100:00100000:3.0:1783967249.659885:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783967249.659895:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588027392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967249.660079:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588027392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967249.660088:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783967249.662586:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783967249.662703:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783967249.662867:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967249.662932:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967249.663439:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027520 00000100:00100000:1.0:1783967249.663449:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027520 00000100:00100000:1.0:1783967249.663520:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783967249.663531:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588027520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967249.663722:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588027520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967249.663731:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783967249.665642:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783967249.667447:0:23847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1783967249.691898:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1783967249.691961:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783967249.691988:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967249.692002:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967249.692015:0:22659:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783967249.692019:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c31ac800 from 13 10000000:01000000:2.0:1783967249.692022:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783967249.692090:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967249.692100:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967249.692115:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967249.692149:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783967249.692278:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967249.692340:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967249.692595:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027648 00000100:00100000:0.0:1783967249.692605:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027648 00000100:00100000:0.0:1783967249.692676:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783967249.692688:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+17:22659:x1870624588027648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967249.692705:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967249.692722:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a46 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.692765:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a46 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.692795:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a46 expref: 18 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.692805:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050600, rc 0) 00000100:00100000:0.0:1783967249.692870:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:22659:x1870624588027648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967249.692877:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783967249.694876:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967249.694914:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967249.694931:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967249.695056:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783967249.695384:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967249.695434:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed18bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783967249.696509:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027776 00000100:00100000:0.0:1783967249.696526:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027776 00000100:00100000:0.0:1783967249.696606:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783967249.696618:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:22659:x1870624588027776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967249.697058:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:22659:x1870624588027776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967249.697238:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967249.697309:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967249.697386:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967249.697424:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f11e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967249.697446:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588027904 00000100:00100000:3.0:1783967249.697451:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588027904 00000100:00100000:3.0:1783967249.697485:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783967249.697493:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+19:22659:x1870624588027904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967249.697607:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+19:22659:x1870624588027904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967249.697622:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783967249.697706:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588027904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967249.698335:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:0.0:1783967249.703813:0:23849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783967249.707291:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783967249.707344:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783967249.707362:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967249.707378:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967249.975136:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967250.361436:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967251.005235:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967251.511764:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783967252.027010:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967252.348582:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588028032:0@lo:400:kworker.0 00000100:00100000:1.0:1783967252.348725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783967252.348839:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967252.348844:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967252.348847:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967252.348850:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967252.348877:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967252.348881:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967252.348883:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967252.348885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967252.348912:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588028160:0@lo:400:kworker.0 00000100:00100000:2.0:1783967252.348957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967252.349021:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588028544:0@lo:400:kworker.0 00000100:00100000:1.0:1783967252.349049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967252.349082:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028544 00000100:00100000:1.0:1783967252.349089:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028544 00000100:00100000:1.0:1783967252.349131:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967252.349140:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588028544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967252.349189:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588028544:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967252.349197:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783967252.349233:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3728700 x1870624588028544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967252.349247:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588028544:0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349314:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028032 00000100:00100000:3.0:1783967252.349318:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028032 00000100:00100000:3.0:1783967252.349355:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783967252.349361:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:3647:x1870624588028032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349396:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:3647:x1870624588028032:12345-0@lo:400:kworker.0 Request processed in 35us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967252.349402:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783967252.349431:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588028032:0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349462:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588028416:0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967252.349500:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783967252.349505:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588028288:0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349521:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967252.349543:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028160 00000100:00100000:3.0:1783967252.349551:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028160 00000100:00100000:3.0:1783967252.349572:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028416 00000100:00100000:3.0:1783967252.349574:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028416 00000100:00100000:3.0:1783967252.349585:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783967252.349590:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588028160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349709:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588028160:12345-0@lo:400:kworker.0 Request processed in 118us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967252.349715:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783967252.349728:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783967252.349734:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588028416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349787:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588028416:12345-0@lo:400:kworker.0 Request processed in 36us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967252.349793:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783967252.349808:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028288 00000100:00100000:3.0:1783967252.349811:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028288 00000100:00100000:3.0:1783967252.349829:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783967252.349835:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588028288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967252.349859:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588028288:12345-0@lo:400:kworker.0 Request processed in 25us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967252.349864:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1783967252.349950:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3728e00 x1870624588028288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967252.349972:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588028288:0@lo:400:kworker.0 00000100:00100000:1.0:1783967252.349983:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588028416:0@lo:400:kworker.0 00000100:00100000:2.0:1783967252.350044:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588028160:0@lo:400:kworker.0 00010000:00010000:1.0:1783967253.054406:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967253.367453:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783967253.367476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588028672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967253.367546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967253.367592:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028672 00000100:00100000:1.0:1783967253.367600:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028672 00000100:00100000:1.0:1783967253.367647:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967253.367656:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588028672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967253.367689:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967253.367732:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588028672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967253.367738:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967253.367812:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588028672:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967253.371797:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588028800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967253.371864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967253.372161:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028800 00000100:00100000:1.0:1783967253.372169:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028800 00000100:00100000:1.0:1783967253.372218:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967253.372228:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588028800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783967253.372263:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967253.372309:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588028800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967253.372523:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967253.372584:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588028800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1783967254.075294:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967255.097755:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967256.119082:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967257.149994:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783967257.462929:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967257.462937:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967257.462941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967257.462944:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967257.462965:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967257.462976:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783967257.462979:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783967257.462982:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783967257.463160:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588028928:0@lo:400:kworker.0 00000100:00100000:1.0:1783967257.463267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967257.463375:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588028928 00000100:00100000:3.0:1783967257.463386:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588028928 00000100:00100000:3.0:1783967257.463455:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783967257.463468:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:3646:x1870624588028928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.463541:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:3646:x1870624588028928:12345-0@lo:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967257.463550:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783967257.465367:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588029312:0@lo:400:kworker.0 00000100:00100000:2.0:1783967257.465444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967257.465864:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588028928:0@lo:400:kworker.0 00000100:00100000:1.0:1783967257.465880:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624588029440:0@lo:400:kworker.0 00000100:00100000:1.0:1783967257.465937:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967257.466182:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029440 00000100:00100000:3.0:1783967257.466190:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029440 00000100:00100000:3.0:1783967257.466261:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967257.466273:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624588029440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.466344:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624588029440:12345-0@lo:400:kworker.0 Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967257.466352:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783967257.466389:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c372ad80 x1870624588029440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967257.466403:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624588029440:0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.466861:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588029184:0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.466902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967257.466935:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967257.466943:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588029056:0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.466973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967257.467015:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029312 00000100:00100000:3.0:1783967257.467020:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029312 00000100:00100000:3.0:1783967257.467053:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029056 00000100:00100000:3.0:1783967257.467056:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029056 00000100:00100000:3.0:1783967257.467072:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783967257.467080:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588029312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.467123:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588029312:12345-0@lo:400:kworker.0 Request processed in 44us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967257.467130:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783967257.467142:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783967257.467148:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588029056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967257.467202:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588029056:12345-0@lo:400:kworker.0 Request processed in 54us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967257.467209:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783967257.467244:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588029056:0@lo:400:kworker.0 00000100:00100000:1.0:1783967257.467334:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029184 00000100:00100000:1.0:1783967257.467339:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029184 00000100:00100000:1.0:1783967257.467366:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967257.467374:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588029184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967257.467413:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1870624588029184:12345-0@lo:400:kworker.0 Request processed in 40us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967257.467420:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783967257.467485:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c3728a80 x1870624588029184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967257.467497:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1870624588029184:0@lo:400:kworker.0 00000100:00100000:2.0:1783967257.468439:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588029312:0@lo:400:kworker.0 00000020:01000004:2.0:1783967257.849286:0:24164:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783967257.849290:0:24164:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1783967257.849291:0:24164:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1783967257.849401:0:24164:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a05f570c000 00000020:01000004:2.0:1783967257.849418:0:24164:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783967257.849433:0:24164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1783967257.849447:0:24164:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a05f4f70000) 00000020:00000080:2.0:1783967257.849464:0:24164:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1783967257.949561:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1783967257.951683:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1783967257.952062:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1783967257.952654:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1783967257.952897:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1783967257.953804:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1783967257.954363:0:24164:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1783967257.957323:0:24164:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1783967257.957559:0:24164:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783967257.957573:0:24164:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783967257.957584:0:24164:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9269c8b316068a5b 00000020:01000004:0.0:1783967257.957599:0:24164:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1783967257.957616:0:24164:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783967257.957619:0:24164:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783967257.957624:0:24164:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783967257.957628:0:24164:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783967257.957636:0:24164:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a05f55f3380) 00000020:00000080:0.0:1783967257.957643:0:24164:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1783967257.959534:0:24164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967257.959993:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783967257.960000:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783967257.960807:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783967257.960821:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783967257.961325:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783967257.961331:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783967257.965740:0:24164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783967257.965989:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783967257.965995:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1783967257.971118:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1783967257.971135:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783967257.991227:0:24164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783967257.991537:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783967257.991545:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783967257.993406:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783967257.993417:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783967257.994500:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783967257.994514:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783967257.998113:0:24164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783967257.998284:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783967257.998290:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783967257.999171:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783967257.999178:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1783967258.028050:0:24164:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783967258.028196:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1783967258.028200:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783967258.029017:0:24164:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783967258.029028:0:24164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783967258.029357:0:24164:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783967258.029383:0:24164:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1783967258.029390:0:24164:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783967258.043721:0:24164:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783967258.043835:0:24164:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.159@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783967258.043840:0:24164:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783967258.043842:0:24164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967258.043843:0:24164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967258.043844:0:24164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967258.043845:0:24164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967258.043846:0:24164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967258.043848:0:24164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967258.043849:0:24164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967258.043851:0:24164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967258.043854:0:24164:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783967258.043857:0:24164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783967258.043858:0:24164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967258.043859:0:24164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967258.043860:0:24164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967258.043861:0:24164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967258.043862:0:24164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967258.043863:0:24164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967258.043864:0:24164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967258.043865:0:24164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783967258.043894:0:24164:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783967258.043916:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783967258.043992:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967258.044483:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029568 00000100:00100000:1.0:1783967258.044492:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029568 00000100:00100000:1.0:1783967258.044597:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783967258.044608:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:24164:x1870624588029568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783967258.044636:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783967258.044639:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1783967258.044643:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783967258.044693:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c97f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.048704:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+18:24164:x1870624588029568:12345-0@lo:253:mount.lustre.0 Request processed in 4088us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.048711:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783967258.048723:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 10000000:01000000:2.0:1783967258.048729:0:24164:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783967258.048735:0:24164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783967258.048737:0:24164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783967258.048738:0:24164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783967258.048739:0:24164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783967258.048741:0:24164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783967258.048742:0:24164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783967258.048744:0:24164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783967258.048746:0:24164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783967258.048762:0:24164:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783967258.048831:0:24164:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a05f570c000 from lustre-OST0000 10000000:01000000:2.0:1783967258.048875:0:24164:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783967258.048879:0:24164:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783967258.048887:0:24164:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a04c34799c0 local copy 00010000:00010000:2.0:1783967258.048897:0:24164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967258.049005:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967258.049216:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967258.049320:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c8119780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967258.050191:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029696 00000100:00100000:3.0:1783967258.050199:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029696 00000100:00100000:3.0:1783967258.050357:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783967258.050367:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:24164:x1870624588029696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967258.050480:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+18:24164:x1870624588029696:12345-0@lo:501:mount.lustre.0 Request processed in 114us (1264us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783967258.050488:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783967258.050577:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029696:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783967258.050599:0:24164:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783967258.050627:0:24164:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783967258.050635:0:24164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.050646:0:24164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967258.050688:0:24164:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a05f570c000 10000000:01000000:0.0:1783967258.050693:0:24164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783967258.050698:0:24164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783967258.050701:0:24164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783967258.050705:0:24164:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783967258.050708:0:24164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783967258.050748:0:24164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.050756:0:24164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.050766:0:24164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967258.050826:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967258.050860:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.051477:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed235000 going to sleep for 11 seconds 00000100:00100000:2.0:1783967258.051588:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029824 00000100:00100000:2.0:1783967258.051594:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029824 00000100:00100000:2.0:1783967258.051624:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783967258.051631:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+18:24164:x1870624588029824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967258.051642:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967258.051655:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631000/0x9269c8b316068a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a69 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.051676:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631000/0x9269c8b316068a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a69 expref: 19 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.051686:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631000/0x9269c8b316068a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a69 expref: 19 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.051695:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631000, rc 0) 00000100:00100000:2.0:1783967258.051742:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588029824:12345-0@lo:101:mount.lustre.0 Request processed in 111us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.051749:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783967258.051931:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967258.051945:0:24164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a70 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.051955:0:24164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a70 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783967258.055331:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1783967258.057128:0:24164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967258.059752:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1783967258.060006:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1783967258.060025:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1783967258.060038:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1783967258.060050:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1783967258.060063:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1783967258.060075:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1783967258.060087:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1783967258.060098:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1783967258.060112:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1783967258.060125:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1783967258.060137:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1783967258.060173:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1783967258.060180:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1783967258.060506:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967258.060586:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.060635:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783967258.060651:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588029952 00000100:00100000:2.0:1783967258.060666:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588029952 00000100:00100000:2.0:1783967258.060723:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783967258.060735:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588029952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967258.060958:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588029952:12345-0@lo:501:mount.lustre.0 Request processed in 225us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.060967:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783967258.061353:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588029952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967258.061388:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030080:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783967258.061429:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.061449:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31afa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.063406:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030080 00000100:00100000:1.0:1783967258.063419:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030080 00000100:00100000:1.0:1783967258.063488:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783967258.063498:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967258.066119:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030080:12345-0@lo:503:mount.lustre.0 Request processed in 2612us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.066134:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783967258.066397:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783967258.066894:0:24164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783967258.066998:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967258.067045:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.067087:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a840 going to sleep for 11 seconds 00000100:00100000:3.0:1783967258.067441:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030208 00000100:00100000:3.0:1783967258.067448:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030208 00000100:00100000:3.0:1783967258.067500:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783967258.067511:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967258.070525:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030208:12345-0@lo:502:mount.lustre.0 Request processed in 3008us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967258.070539:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783967258.070765:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783967258.071216:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783967258.071415:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1783967258.071429:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1783967258.071440:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1783967258.071452:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1783967258.071464:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1783967258.071477:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1783967258.071490:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1783967258.071504:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1783967258.071518:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1783967258.071531:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1783967258.071543:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1783967258.071581:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967258.071634:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.071733:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.072414:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030336 00000100:00100000:1.0:1783967258.072422:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030336 00000100:00100000:1.0:1783967258.072480:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783967258.072491:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967258.072729:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030336:12345-0@lo:502:mount.lustre.0 Request processed in 239us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.072746:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783967258.076065:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967258.076576:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1783967258.076594:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1783967258.077540:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783967258.077549:0:24181:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1783967258.077556:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783967258.077558:0:24181:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783967258.077564:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783967258.077580:0:24181:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a05f4f73380) 00000020:00000080:2.0:1783967258.077943:0:24181:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783967258.077954:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783967258.078048:0:24181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05f570c000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783967258.078057:0:24181:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783967258.078064:0:24181:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9269c8b316068a7e 00010000:00010000:3.0:1783967258.082257:0:24181:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1783967258.084171:0:24181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:3.0:1783967258.085592:0:24181:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1783967258.086886:0:24181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783967258.086897:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967258.086903:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967258.086905:0:24181:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783967258.086908:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783967258.086911:0:24181:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1783967258.086912:0:24181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967258.086913:0:24181:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783967258.086915:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783967258.086916:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967258.086918:0:24181:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783967258.086920:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967258.086922:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967258.086923:0:24181:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783967258.086926:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783967258.086928:0:24181:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783967258.086930:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967258.086932:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967258.086933:0:24181:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783967258.086935:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967258.086937:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967258.086938:0:24181:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783967258.086941:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783967258.086966:0:24181:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967258.086968:0:24181:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967258.086970:0:24181:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783967258.086972:0:24181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1783967258.087128:0:24164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783967258.087161:0:24164:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783967258.087179:0:24164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a70 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.087191:0:24164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050200/0x9269c8b316068a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a70 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967258.087200:0:24164:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f570c000 from 1 10000000:01000000:0.0:1783967258.087203:0:24164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967258.087241:0:24164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.087249:0:24164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.087260:0:24164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967258.087292:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967258.087357:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.087438:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.087688:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030464 00000100:00100000:1.0:1783967258.087696:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030464 00000100:00100000:1.0:1783967258.087799:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783967258.087821:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:24164:x1870624588030464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967258.087842:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967258.087855:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a85 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.087881:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a85 expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.087892:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a85 expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.087906:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1800, rc 0) 00000100:00100000:1.0:1783967258.087950:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030464:12345-0@lo:101:mount.lustre.0 Request processed in 142us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.087957:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783967258.088208:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967258.088222:0:24164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.088229:0:24164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783967258.095272:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1783967258.095879:0:24164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967258.096209:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1783967258.096237:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1783967258.096251:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1783967258.096264:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1783967258.096277:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1783967258.096703:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1783967258.096726:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1783967258.096741:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1783967258.096754:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1783967258.096786:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1783967258.096803:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1783967258.096832:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1783967258.096838:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1783967258.096920:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967258.096992:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.097032:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.098133:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030592 00000100:00100000:1.0:1783967258.098141:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030592 00000100:00100000:1.0:1783967258.098189:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783967258.098199:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967258.098340:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030592:12345-0@lo:501:mount.lustre.0 Request processed in 142us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.098347:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783967258.098973:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967258.099021:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967258.099072:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967258.099110:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.099678:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030720 00000100:00100000:1.0:1783967258.099683:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030720 00000100:00100000:1.0:1783967258.099706:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783967258.099710:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783967258.099860:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030720:12345-0@lo:503:mount.lustre.0 Request processed in 147us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.099877:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783967258.099884:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783967258.100390:0:24164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783967258.100465:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967258.100509:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967258.100544:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1783967258.100568:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030848 00000100:00100000:0.0:1783967258.100575:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030848 00000100:00100000:0.0:1783967258.100618:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783967258.100629:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967258.100699:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030848:12345-0@lo:502:mount.lustre.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967258.100704:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783967258.100784:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967258.101089:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783967258.101109:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783967258.101129:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783967258.101137:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783967258.101144:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783967258.101151:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783967258.101158:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783967258.101164:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1783967258.101171:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783967258.101178:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1783967258.101185:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1783967258.101200:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967258.101227:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967258.101428:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1783967258.101514:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588030976 00000100:00100000:0.0:1783967258.101519:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588030976 00000100:00100000:0.0:1783967258.101556:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783967258.101562:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967258.101629:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588030976:12345-0@lo:502:mount.lustre.0 Request processed in 67us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967258.101637:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783967258.102691:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588030976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967258.102815:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1783967258.102830:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1783967258.104545:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967258.104555:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.104558:0:24185:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783967258.104565:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05f570c000 00000020:00000080:3.0:1783967258.104567:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967258.104576:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967258.104579:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.104581:0:24185:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783967258.104583:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967258.104585:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.104587:0:24185:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783967258.104591:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a05f570c000 00000020:00000080:3.0:1783967258.104593:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967258.104803:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967258.104816:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.104818:0:24185:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783967258.104821:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967258.104824:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.104825:0:24185:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783967258.104828:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05f570c000 00000020:00000080:3.0:1783967258.104831:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967258.108406:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967258.108418:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.108420:0:24185:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783967258.108425:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783967258.108429:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.108431:0:24185:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1783967258.108436:0:24185:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a05f570c000 00000020:00000080:3.0:1783967258.108438:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783967258.108500:0:24185:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783967258.110350:0:24185:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967258.110352:0:24185:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1783967258.110359:0:24185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1783967258.111598:0:24164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1783967258.111638:0:24164:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783967258.111668:0:24164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.111681:0:24164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967258.111740:0:24164:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783967258.111743:0:24164:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a05f570c000 10000000:01000000:0.0:1783967258.111747:0:24164:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a05f570c000 10000000:01000000:0.0:1783967258.111751:0:24164:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783967258.111757:0:24164:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a05f570c000 from 1 10000000:01000000:0.0:1783967258.111761:0:24164:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783967258.111845:0:24164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.111861:0:24164:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.111874:0:24164:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967258.111901:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783967258.111970:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.112008:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7d31600 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.112099:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031104 00000100:00100000:1.0:1783967258.112107:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031104 00000100:00100000:1.0:1783967258.112150:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783967258.112160:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+20:24164:x1870624588031104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967258.112174:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967258.112188:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1200/0x9269c8b316068a9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068a93 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.112211:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1200/0x9269c8b316068a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068a93 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.112221:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1200/0x9269c8b316068a9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a93 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.112230:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1200, rc 0) 00000100:00100000:1.0:1783967258.112283:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031104:12345-0@lo:101:mount.lustre.0 Request processed in 125us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.112290:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783967258.112494:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967258.112508:0:24164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a9a expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.112516:0:24164:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068a9a expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783967258.131384:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1783967258.133011:0:24164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967258.134615:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783967258.134745:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783967258.134787:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783967258.134820:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783967258.134841:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783967258.134858:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783967258.134876:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783967258.134911:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783967258.134929:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783967258.134950:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783967258.134974:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783967258.135008:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783967258.135969:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783967258.136004:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783967258.136019:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783967258.136114:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783967258.136132:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783967258.136148:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783967258.136162:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783967258.136178:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783967258.136197:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783967258.136546:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783967258.136710:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783967258.136746:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783967258.136762:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1783967258.136798:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1783967258.136827:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1783967258.136844:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1783967258.136858:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1783967258.136870:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1783967258.136882:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1783967258.136895:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1783967258.136908:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1783967258.136920:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1783967258.136932:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1783967258.136946:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1783967258.136960:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1783967258.136975:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1783967258.136991:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1783967258.137021:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1783967258.138005:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1783967258.138031:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1783967258.138048:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1783967258.138063:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1783967258.138076:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1783967258.138088:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1783967258.138102:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1783967258.138116:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1783967258.138284:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1783967258.138302:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1783967258.138319:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1783967258.138325:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1783967258.138431:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967258.138495:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967258.138546:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.139143:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031232 00000100:00100000:1.0:1783967258.139150:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031232 00000100:00100000:1.0:1783967258.139210:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783967258.139221:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967258.139360:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031232:12345-0@lo:501:mount.lustre.0 Request processed in 140us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.139369:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783967258.139520:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967258.139555:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967258.139593:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967258.139621:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15ca900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967258.139674:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031360 00000100:00100000:2.0:1783967258.139678:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031360 00000100:00100000:2.0:1783967258.139707:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783967258.139713:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967258.139895:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031360:12345-0@lo:503:mount.lustre.0 Request processed in 181us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.139902:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783967258.140583:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783967258.141073:0:24164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967258.141164:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967258.141215:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967258.141246:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15ca900 going to sleep for 11 seconds 00000100:00100000:1.0:1783967258.141335:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031488 00000100:00100000:1.0:1783967258.141348:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031488 00000100:00100000:1.0:1783967258.141390:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783967258.141399:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967258.141493:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031488:12345-0@lo:502:mount.lustre.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.141501:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783967258.142218:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967258.142525:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783967258.142550:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783967258.142559:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783967258.142567:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783967258.142576:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783967258.142590:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783967258.142606:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783967258.142622:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783967258.142638:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783967258.142655:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783967258.142671:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783967258.142685:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783967258.142702:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783967258.142720:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783967258.142752:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783967258.142786:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783967258.142803:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783967258.142833:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783967258.142847:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783967258.142860:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783967258.142874:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783967258.142885:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783967258.142896:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783967258.142907:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783967258.142919:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1783967258.142929:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1783967258.142942:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1783967258.142954:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1783967258.142966:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1783967258.142979:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1783967258.143078:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1783967258.143093:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1783967258.143116:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1783967258.143132:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1783967258.143219:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1783967258.143242:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1783967258.143261:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1783967258.143280:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1783967258.143297:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1783967258.143310:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1783967258.143322:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1783967258.143334:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1783967258.143345:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1783967258.143360:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1783967258.143374:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1783967258.143387:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1783967258.143492:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1783967258.143512:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1783967258.143558:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967258.143625:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967258.143724:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15ca900 going to sleep for 11 seconds 00000100:00100000:0.0:1783967258.143766:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031616 00000100:00100000:0.0:1783967258.143905:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031616 00000100:00100000:0.0:1783967258.143961:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783967258.143969:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967258.144389:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031616:12345-0@lo:502:mount.lustre.0 Request processed in 419us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967258.144398:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783967258.144544:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967258.144751:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1783967258.144864:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1783967258.144894:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967258.144936:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.145088:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031744 00000100:00100000:0.0:1783967258.145093:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031744 00000100:00100000:0.0:1783967258.145121:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783967258.145128:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783967258.145213:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588031744:12345-0@lo:502:mount.lustre.0 Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967258.145221:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783967258.145337:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15ca900 going to sleep for 11 seconds 00000100:00100000:3.0:1783967258.145352:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588031744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967258.145387:0:24164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1783967258.145395:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1783967258.148620:0:24190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783967258.148644:0:24190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a05ea238000) 00000020:00000080:3.0:1783967258.148671:0:24190:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1783967258.148877:0:24190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05f570c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783967258.148882:0:24190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05f570c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783967258.148885:0:24190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f570c000 3 00010000:00080000:3.0:1783967258.148920:0:24190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c1f6d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967258.152101:0:24190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1783967258.152348:0:24190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783967258.152398:0:24190:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783967258.152423:0:24190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9269c8b316068aa8 00000100:00080000:3.0:1783967258.152435:0:24190:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967258.152440:0:24190:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a04c1f6d000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967258.152477:0:24190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77e8e00 x1870624588031872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783967258.152543:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588031872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967258.152629:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.153444:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588031872 00000100:00100000:0.0:1783967258.153453:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588031872 00000100:00100000:0.0:1783967258.153490:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783967258.153499:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588031872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783967258.153524:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 734 last 0 00000020:00000080:0.0:1783967258.153596:0:22662:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9269c8b316068aaf 00000004:00100000:0.0:1783967258.153612:0:22662:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783967258.153657:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9a05c9def800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1783967258.154666:0:24190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783967258.155145:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588032000:0@lo:400:kworker.0 00000100:00100000:0.0:1783967258.155162:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1870624588031872:12345-0@lo:38:llog_process_th.0 Request processed in 1660us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967258.155173:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783967258.155208:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783967258.155260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967258.155264:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967258.155267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967258.155270:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967258.155330:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032000 00000100:00100000:3.0:1783967258.155337:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032000 00000100:00100000:2.0:1783967258.155371:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783967258.155379:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588032128:0@lo:400:kworker.0 00000100:00080000:1.0:1783967258.155478:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967258.155482:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783967258.155536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967258.155539:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967258.156299:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967258.156530:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588032256:0@lo:400:kworker.0 00000100:00100000:1.0:1783967258.156571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967258.156633:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967258.156652:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588032384:0@lo:400:kworker.0 00000100:00100000:1.0:1783967258.156679:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967258.156884:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032128 00000100:00100000:1.0:1783967258.156891:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032128 00000100:00100000:1.0:1783967258.156930:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032384 00000100:00100000:1.0:1783967258.156933:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032384 00000100:00100000:1.0:1783967258.156952:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967258.156961:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588032128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967258.157046:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588032128:12345-0@lo:400:kworker.0 Request processed in 85us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.157054:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783967258.157073:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783967258.157080:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588032384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967258.157113:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588032384:12345-0@lo:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.157118:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1783967258.157155:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c1f12300 x1870624588032128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967258.157181:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588032128:0@lo:400:kworker.0 00010000:00080000:1.0:1783967258.157213:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a04c1f10700 x1870624588032384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967258.157222:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588032384:0@lo:400:kworker.0 00000100:00100000:3.0:1783967258.161005:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032256 00000100:00100000:3.0:1783967258.161018:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032256 00000100:00100000:3.0:1783967258.161055:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967258.161062:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588032000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967258.161153:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588032000:12345-0@lo:400:kworker.0 Request processed in 90us (5944us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967258.161160:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783967258.161181:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967258.161198:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588032256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967258.161234:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588032256:12345-0@lo:400:kworker.0 Request processed in 47us (4662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967258.161255:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783967258.161322:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588032000:0@lo:400:kworker.0 00000100:00100000:3.0:1783967258.161355:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588032256:0@lo:400:kworker.0 00010000:00080000:3.0:1783967258.161410:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05e77e8e00 x1870624588031872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967258.161420:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783967258.161428:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1783967258.161435:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783967258.161440:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783967258.161442:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783967258.161448:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1870624588031872:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1783967258.161557:0:24190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1783967258.161573:0:24190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a05ea23b380) 00000020:00000080:3.0:1783967258.161594:0:24190:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1783967258.161904:0:24190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a05f570c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783967258.161908:0:24190:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a05f570c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783967258.161910:0:24190:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a05f570c000 3 00010000:00080000:3.0:1783967258.161944:0:24190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c3486000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967258.163502:0:24190:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1783967258.163596:0:24190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1783967258.163724:0:24190:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783967258.163735:0:24190:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9269c8b316068abd 00000100:00080000:3.0:1783967258.163744:0:24190:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967258.163750:0:24190:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a04c3486000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967258.163812:0:24190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05e77e8e00 x1870624588032512/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967258.163845:0:24190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1783967258.163877:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967258.163882:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967258.163885:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967258.163888:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967258.163892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967258.163895:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783967258.163897:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967258.163900:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783967258.164228:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624588032512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967258.164297:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1783967258.166968:0:24190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:1.0:1783967258.167166:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032512 00000100:00100000:1.0:1783967258.167175:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032512 00000100:00100000:1.0:1783967258.167229:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967258.167238:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588032512:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783967258.167268:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 734 last 0 00000020:00000080:1.0:1783967258.167306:0:22662:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9269c8b316068ac4 00000004:00100000:1.0:1783967258.167453:0:22662:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783967258.167488:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9a05ed193800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967258.167676:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1870624588032512:12345-0@lo:38:llog_process_th.0 Request processed in 437us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967258.167692:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783967258.168226:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783967258.168239:0:24164:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1783967258.168279:0:24164:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783967258.168298:0:24164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a9a expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.168310:0:24164:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602050c00/0x9269c8b316068a93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068a9a expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783967258.168367:0:24164:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783967258.168370:0:24164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783967258.168371:0:24164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967258.168373:0:24164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967258.168374:0:24164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967258.168380:0:24164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967258.168382:0:24164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783967258.168384:0:24164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967258.168385:0:24164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783967258.168389:0:24164:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1783967258.168392:0:24164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783967258.168393:0:24164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783967258.168395:0:24164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967258.168396:0:24164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967258.168397:0:24164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967258.168399:0:24164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967258.168400:0:24164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783967258.168401:0:24164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967258.168403:0:24164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783967258.168424:0:24164:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783967258.168442:0:24164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588032640:0@lo:253:mount.lustre.0 00010000:00080000:2.0:1783967258.168448:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a05e77e8e00 x1870624588032512/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967258.168462:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967258.168471:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1783967258.168480:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783967258.168485:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783967258.168487:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3486000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783967258.168497:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1870624588032512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783967258.168500:0:24164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.168541:0:24164:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c81190c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967258.168564:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032640 00000100:00100000:0.0:1783967258.168568:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032640 00000100:00100000:0.0:1783967258.168606:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783967258.168615:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588032640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783967258.168637:0:22657:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783967258.168652:0:22657:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783967258.179730:0:22657:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783967258.179751:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783967258.179823:0:22678:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783967258.179830:0:22678:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783967258.179854:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.179874:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a0e expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.179883:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a1c expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.179892:0:22678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.179935:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068a1c expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.179950:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068a1c expref: 21 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967258.179963:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588032768:0@lo:104: 00000100:00100000:1.0:1783967258.181135:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783967258.181207:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068a0e expref: 21 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967258.181218:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068a0e expref: 21 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967258.181230:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588032896:0@lo:104: 00000100:00100000:1.0:1783967258.181282:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967258.181311:0:22678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967258.181360:0:22646:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783967258.181380:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032768 00000100:00100000:2.0:1783967258.181387:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032768 00000100:00100000:2.0:1783967258.181419:0:22646:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588032896 00000100:00100000:2.0:1783967258.181429:0:22646:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588032896 00000100:00100000:2.0:1783967258.181449:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967258.181457:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+4:22678:x1870624588032768:12345-0@lo:104: 00010000:00010000:2.0:1783967258.181469:0:22646:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.181545:0:22646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783967258.181553:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+4:22678:x1870624588032768:12345-0@lo:104: Request processed in 97us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.181561:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783967258.181570:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588032768:0@lo:104: 00000100:00100000:2.0:1783967258.181583:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783967258.181591:0:22646:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588032896:12345-0@lo:104: 00010000:00010000:2.0:1783967258.181599:0:22646:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.181640:0:22646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783967258.181645:0:22646:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3d52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588032896:12345-0@lo:104: Request processed in 56us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.181651:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967258.181695:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588032896:0@lo:104: 00010000:00010000:1.0:1783967258.181718:0:22678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.181838:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783967258.181845:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.181853:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967258.181858:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.181867:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967258.181875:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967258.181882:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783967258.181924:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.181936:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783967258.181941:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967258.181965:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.181973:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068a1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a23 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.181989:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967258.181992:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967258.181995:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967258.182000:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24164:x1870624588032640:12345-0@lo:253:mount.lustre.0 Request processed in 13384us (13499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967258.182011:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588033024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967258.182014:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783967258.182021:0:24164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24164:1870624588032640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783967258.182035:0:24164:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783967258.182038:0:24164:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783967258.182039:0:24164:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783967258.182041:0:24164:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783967258.182042:0:24164:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783967258.182044:0:24164:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783967258.182052:0:24164:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783967258.182053:0:24164:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783967258.182055:0:24164:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783967258.182056:0:24164:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783967258.182067:0:24164:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1783967258.182155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783967258.182539:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967258.182543:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967258.182545:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967258.182581:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.182590:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967258.182593:0:22651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.182600:0:22651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967258.182606:0:22651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967258.182612:0:22651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783967258.182637:0:22651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.182653:0:22651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967258.182667:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.182673:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050400/0x9269c8b316068a0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a15 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.182686:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967258.182688:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967258.182689:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967258.182791:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967258.182803:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588033152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967258.182845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967258.184379:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033024 00000100:00100000:0.0:1783967258.184379:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033152 00000100:00100000:0.0:1783967258.184390:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033152 00000100:00100000:1.0:1783967258.184391:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033024 00010000:00010000:1.0:1783967258.184577:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a1c expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967258.184627:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783967258.184638:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+22:3647:x1870624588033024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967258.184652:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967258.184658:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a1c expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.184680:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068a1c expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.184697:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631800/0x9269c8b316068a23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068a1c expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.184865:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a0e expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967258.184899:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783967258.184907:0:22648:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783967258.184921:0:22649:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1783967258.184940:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783967258.184949:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef379c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23275f43-9903-4089-8dbf-9caac6a945f7+22:3647:x1870624588033152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783967258.184959:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967258.184965:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a0e expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.184975:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068a0e expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.184986:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f5631200/0x9269c8b316068a15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068a0e expref: 22 pid: 22655 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185000:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185016:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783967258.185030:0:22649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005201174s 00010000:00010000:3.0:1783967258.185034:0:22649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185040:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185046:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185052:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185058:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967258.185061:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.185068:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967258.185569:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783967258.185572:0:22678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967258.185581:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967258.185643:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+20:3647:x1870624588033024:12345-0@lo:103:ldlm_bl.0 Request processed in 1006us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.185650:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967258.185665:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05e77eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588033024:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1783967258.185712:0:24164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:3.0:1783967258.186570:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.186583:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068acb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967258.186600:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967258.186723:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef379c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23275f43-9903-4089-8dbf-9caac6a945f7+19:3647:x1870624588033152:12345-0@lo:103:ldlm_bl.0 Request processed in 1775us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967258.186732:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967258.186801:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588033152:0@lo:103:ldlm_bl.0 00002000:00080000:2.0:1783967258.187915:0:24164:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783967258.187920:0:24164:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783967258.188002:0:24164:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783967258.188045:0:24164:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783967258.188066:0:24164:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783967258.188090:0:24164:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1783967258.189181:0:24164:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967258.189369:0:24164:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1783967258.488092:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588033408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967258.488164:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967258.488211:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967258.488217:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588033280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967258.488238:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967258.488310:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033408 00000100:00100000:2.0:1783967258.488318:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033408 00000100:00100000:2.0:1783967258.488368:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033280 00000100:00100000:2.0:1783967258.488371:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033280 00000100:00100000:2.0:1783967258.488387:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783967258.488395:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588033408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967258.488430:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783967258.488483:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588033408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.488492:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783967258.488507:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783967258.488512:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588033280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967258.488528:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967258.488554:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588033280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 42us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967258.488573:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783967258.488613:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588033280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967258.488625:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588033408:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1783967258.821227:0:24245:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1783967258.821444:0:24245:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1783967259.195378:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783967259.766840:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967259.766848:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c371f800 from 13 10000000:01000000:0.0:1783967259.766853:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967259.766901:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967259.766925:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967259.766936:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967259.766963:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967259.767032:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967259.767121:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967259.767159:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033536 00000100:00100000:1.0:1783967259.767167:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033536 00000100:00100000:1.0:1783967259.767242:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783967259.767251:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+19:22659:x1870624588033536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967259.767263:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967259.767276:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068ad2 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967259.767299:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967259.767309:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 20 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967259.767327:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:1.0:1783967259.767376:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+20:22659:x1870624588033536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967259.767383:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783967259.767468:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967259.767485:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967259.767496:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967259.767547:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783967259.767583:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967259.776022:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15cab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783967259.776213:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033664 00000100:00100000:0.0:1783967259.776222:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033664 00000100:00100000:0.0:1783967259.776275:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783967259.776284:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+20:22659:x1870624588033664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783967259.776309:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783967259.776331:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783967259.776334:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1783967259.776740:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+20:22659:x1870624588033664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 456us (9155us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967259.776749:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783967259.776960:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783967259.777031:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783967259.777041:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967259.777052:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967259.777073:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783967259.777076:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a04c31ac800 from 13 10000000:01000000:3.0:1783967259.777079:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783967259.777109:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967259.777117:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967259.777126:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967259.777146:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967259.777179:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967259.777279:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967259.777525:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033792 00000100:00100000:1.0:1783967259.777531:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033792 00000100:00100000:1.0:1783967259.777560:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783967259.777567:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+20:22659:x1870624588033792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967259.777576:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967259.777589:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068ae0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967259.777610:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967259.777621:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 21 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967259.777629:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0e00, rc 0) 00000100:00100000:1.0:1783967259.778531:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588033792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 961us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967259.778539:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783967259.780879:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967259.780907:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967259.780920:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967259.780984:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783967259.781039:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967259.782570:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f15cab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783967259.782688:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588033920 00000100:00100000:1.0:1783967259.782697:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588033920 00000100:00100000:1.0:1783967259.782753:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783967259.782763:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588033920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783967259.782815:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783967259.782840:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783967259.782843:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1783967259.782934:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588033920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967259.782943:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783967259.788052:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588033920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783967259.788239:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783967259.788259:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967259.788272:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967260.216187:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967260.600570:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967261.239110:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967261.752791:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783967262.268446:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967262.268493:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967247/real 1783967247] req@ffff9a04c1f12a00 x1870624588026112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967262 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967262.268525:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c1f12a00 x1870624588026112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967262 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967262.268535:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967247/real 1783967247] req@ffff9a04c1f12d80 x1870624588026240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967262 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967262.268544:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a04c1f12d80 x1870624588026240/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967262 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783967262.268573:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a13800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967262.268592:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783967262.268597:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588026112:0@lo:8:kworker.0 00000100:00080000:3.0:1783967262.268603:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783967262.268607:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783967262.268611:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588026240:0@lo:8:kworker.0 00000100:00100000:3.0:1783967262.268697:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588034048:0@lo:400:kworker.0 00000100:00100000:3.0:1783967262.268797:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967262.268836:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034048 00000100:00100000:1.0:1783967262.268844:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034048 00000100:00100000:1.0:1783967262.268893:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783967262.268904:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:3647:x1870624588034048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967262.268926:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967262.268950:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588034176:0@lo:400:kworker.0 00000100:00100000:1.0:1783967262.268955:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:3647:x1870624588034048:12345-0@lo:400:kworker.0 Request processed in 50us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967262.268975:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783967262.268987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967262.269023:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588034048:0@lo:400:kworker.0 00000100:00100000:3.0:1783967262.269046:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034176 00000100:00100000:3.0:1783967262.269050:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034176 00000100:00100000:3.0:1783967262.269089:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783967262.269096:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588034176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967262.269146:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588034176:12345-0@lo:400:kworker.0 Request processed in 50us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967262.269153:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783967262.269190:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588034176:0@lo:400:kworker.0 00000100:00080000:0.0:1783967262.269193:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967262.269199:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783967262.269203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967262.269206:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783967262.269261:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624588034304:0@lo:400:kworker.0 00000100:00100000:3.0:1783967262.269291:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967262.269336:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034304 00000100:00100000:1.0:1783967262.269342:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034304 00000100:00100000:1.0:1783967262.269374:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783967262.269381:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624588034304:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783967262.269457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967262.269467:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783967262.269470:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a13800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967262.269475:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 723 00000100:00080000:0.0:1783967262.269479:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783967262.269484:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a05f1a13800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967262.269517:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee12bb80 x1870624588034560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967262.269535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967262.269538:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783967262.269540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967262.269543:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 723 00000100:00080000:0.0:1783967262.269546:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783967262.269549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967262.269560:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ee128700 x1870624588034688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967262.269595:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588034944:0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.269620:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.269634:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967262.269638:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588034816:0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.269651:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.269663:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588034432:0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.269677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.269687:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967262.269690:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588035072:0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.269707:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.269745:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588034560:0@lo:8:kworker.0 00000100:00100000:0.0:1783967262.269791:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.269810:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ee128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588034688:0@lo:8:kworker.0 00000100:00100000:0.0:1783967262.269830:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.269861:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034560 00000100:00100000:0.0:1783967262.269864:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034560 00000100:00100000:0.0:1783967262.269881:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034688 00000100:00100000:0.0:1783967262.269882:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034688 00000100:00100000:0.0:1783967262.269893:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967262.269897:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588034560:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1783967262.269901:0:24171:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783967262.269910:0:24171:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1783967262.269921:0:24169:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 738 last 0 00000020:00000080:0.0:1783967262.269947:0:24169:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316068aee 00002000:00100000:0.0:1783967262.269960:0:24169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a04c1f2f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1783967262.269965:0:24169:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1783967262.269968:0:24169:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783967262.270125:0:24169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1783967262.270143:0:24169:0:(import.c:65:import_set_state_nolock()) ffff9a05c9deb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967262.270178:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624588034560:12345-0@lo:8:kworker.0 Request processed in 279us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.270185:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967262.270196:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783967262.270200:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588034688:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783967262.270210:0:24169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967262.270229:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588034688:12345-0@lo:8:kworker.0 Request processed in 28us (398us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967262.270296:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783967262.270328:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ee12bb80 x1870624588034560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967262.270337:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783967262.270342:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1783967262.270349:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783967262.270354:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783967262.270356:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a13800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783967262.270370:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783967262.270374:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588034560:0@lo:8:kworker.0 00000100:00080000:0.0:1783967262.270384:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967262.270388:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967262.270391:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588034688:0@lo:8:kworker.0 00000004:00080000:0.0:1783967262.270432:0:23404:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1783967262.270445:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1870624588035328:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1783967262.270468:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.270482:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8bc3240 going to sleep for 11 seconds 00000100:00100000:0.0:1783967262.270493:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588035200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967262.270512:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967262.270546:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035328 00000100:00100000:2.0:1783967262.270547:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035200 00000100:00100000:0.0:1783967262.270551:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035328 00000100:00100000:2.0:1783967262.270554:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035200 00000100:00100000:0.0:1783967262.270581:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783967262.270588:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:23404:x1870624588035328:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1783967262.270659:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783967262.270668:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870624588035200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783967262.270687:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967262.270746:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3646:x1870624588035200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967262.270753:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783967262.270851:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783967262.270872:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba10000 x1870624588035200/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967262.270888:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588035200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967262.272378:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034432 00000100:00100000:0.0:1783967262.272389:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034432 00000100:00100000:0.0:1783967262.272442:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783967262.272451:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588034432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.272535:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588034432:12345-0@lo:400:kworker.0 Request processed in 86us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.272542:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783967262.272566:0:22662:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272573:0:22662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783967262.272582:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272588:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034944 00000100:00100000:0.0:1783967262.272591:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034944 00000100:00100000:0.0:1783967262.272612:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272616:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588034816 00000100:00100000:0.0:1783967262.272618:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588034816 00000100:00100000:0.0:1783967262.272625:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272628:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035072 00000100:00100000:0.0:1783967262.272630:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035072 00000100:00100000:0.0:1783967262.272639:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272643:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783967262.272648:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624588034944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.272696:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624588034944:12345-0@lo:400:kworker.0 Request processed in 47us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.272701:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783967262.272713:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272718:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967262.272724:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588034816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.272758:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588034816:12345-0@lo:400:kworker.0 Request processed in 35us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.272785:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967262.272795:0:22664:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783967262.272799:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783967262.272804:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05e77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588035072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.272828:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05e77eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588035072:12345-0@lo:400:kworker.0 Request processed in 25us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.272833:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1783967262.272861:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967262.272864:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783967262.272890:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ee12b480 x1870624588034816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967262.272902:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588034816:0@lo:400:kworker.0 00010000:00080000:0.0:1783967262.272912:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ee12ad80 x1870624588034944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967262.272921:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee12ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588034944:0@lo:400:kworker.0 00010000:00080000:0.0:1783967262.272955:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ee128380 x1870624588035072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967262.272964:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588035072:0@lo:400:kworker.0 00000100:00100000:0.0:1783967262.272974:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee128e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588034432:0@lo:400:kworker.0 00000100:00100000:1.0:1783967262.286087:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624588034304:12345-0@lo:400:kworker.0 Request processed in 16698us (16787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967262.286100:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1783967262.286358:0:23403:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783967262.286471:0:23403:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 738487701166ns, next at 0ns, rc = 0 00080000:00080000:1.0:1783967262.286476:0:23403:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:0.0:1783967262.287021:0:24169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1783967262.287028:0:24169:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1783967262.287121:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1870624588035328:12345-0@lo:7:osp-pre-0-1.0 Request processed in 16531us (16649us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.287131:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783967262.287420:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba11880 x1870624588035328/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783967278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967262.287437:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1870624588035328:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1783967262.287461:0:23404:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1783967262.287507:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1870624588035456:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783967262.287542:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967262.287570:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9546780 going to sleep for 11 seconds 00000100:00100000:0.0:1783967262.288164:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035456 00000100:00100000:0.0:1783967262.288172:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035456 00000100:00100000:0.0:1783967262.288207:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783967262.288216:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23404:x1870624588035456:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1783967262.288241:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1783967262.288275:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23404:x1870624588035456:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967262.288282:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783967262.288551:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ee129500 x1870624588034304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967262.288575:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ee129500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624588034304:0@lo:400:kworker.0 00010000:00080000:1.0:1783967262.292683:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3709500 x1870624588035456/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783967278 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967262.292702:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1870624588035456:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783967262.292716:0:23404:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1783967262.292814:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1870624588035584:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1783967262.292874:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967262.292914:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9546780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967262.293403:0:24472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035584 00000100:00100000:3.0:1783967262.293410:0:24472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035584 00000100:00100000:3.0:1783967262.293458:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783967262.293467:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23404:x1870624588035584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1783967262.293509:0:24169:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:0.0:1783967262.299842:0:23395:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:0.0:1783967262.332601:0:24165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1783967262.333350:0:24165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1783967262.333936:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23404:x1870624588035584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40464us (41056us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1783967262.333949:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783967262.334031:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3709500 x1870624588035584/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783967278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967262.334044:0:23404:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1783967262.334051:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23404:1870624588035584:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1783967262.334065:0:23404:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1783967262.334112:0:23404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1870624588035712:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1783967262.334224:0:23404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967262.334320:0:23404:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9546780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967262.334333:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035712 00000100:00100000:3.0:1783967262.334341:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035712 00000100:00100000:3.0:1783967262.334384:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783967262.334406:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1870624588035712:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1783967262.334466:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23404:x1870624588035712:12345-0@lo:900:osp-pre-0-1.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967262.334474:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783967262.334498:0:23404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3709500 x1870624588035712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783967278 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967262.334509:0:23404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23404:1870624588035712:0@lo:900:osp-pre-0-1.0 00000001:02000400:0.0:1783967263.093317:0:24537:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783967263.289526:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967263.608178:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588035840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967263.608302:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967263.608369:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783967263.608376:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588035968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967263.608400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967263.608448:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035840 00000100:00100000:0.0:1783967263.608460:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035840 00000100:00100000:0.0:1783967263.613862:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588035968 00000100:00100000:0.0:1783967263.613877:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588035968 00000100:00100000:3.0:1783967263.614436:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783967263.614493:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588035840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967263.614547:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783967263.614644:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588035840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 194us (6354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967263.614653:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783967263.614683:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783967263.614692:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588035968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1783967263.614725:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967263.614762:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588035968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (6361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967263.614808:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783967263.616277:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588035968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967263.616290:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588035840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967264.312115:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967244/real 1783967244] req@ffff9a05fba44380 x1870624588025088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.312145:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba44380 x1870624588025088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.312158:0:3644:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783967244/real 1783967244] req@ffff9a05fba47100 x1870624588024960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967264 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.312167:0:3644:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a05fba47100 x1870624588024960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783967264 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783967264.312186:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967264.312199:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783967264.312203:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588025088:0@lo:8:kworker.0 00000100:00080000:0.0:1783967264.312208:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967264.312211:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1783967264.312213:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588024960:0@lo:8:kworker.0 00010000:00010000:0.0:1783967264.312244:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783967264.312310:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967264.312314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783967264.312317:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967264.312322:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 720 00000100:00080000:0.0:1783967264.312328:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783967264.312336:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a04c3cc2800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967264.312360:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba11c00 x1870624588036352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967264.312372:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967264.312375:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783967264.312377:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967264.312380:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 720 00000100:00080000:0.0:1783967264.312388:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783967264.312392:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967264.312404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba10a80 x1870624588036480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783967264.312439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783967264.312442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783967264.312444:0:37:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783967264.312448:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 738 00000100:00080000:0.0:1783967264.312450:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1783967264.312454:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:0.0:1783967264.312463:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05fba13100 x1870624588036992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783967264.312513:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588036096:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312647:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588036864:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312707:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783967264.312713:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588036224:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312762:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588037120:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312841:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588036608:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312878:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624588037248:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312905:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312921:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783967264.312926:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588036736:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312944:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.312957:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624588037376:0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.312974:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.313003:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036864 00000100:00100000:0.0:1783967264.313012:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036864 00000100:00100000:0.0:1783967264.313079:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967264.313088:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588036864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313141:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588036864:12345-0@lo:400:kworker.0 Request processed in 53us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313150:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783967264.313178:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036224 00000100:00100000:0.0:1783967264.313181:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036224 00000100:00100000:0.0:1783967264.313203:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036736 00000100:00100000:0.0:1783967264.313205:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036736 00000100:00100000:0.0:1783967264.313218:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783967264.313224:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588036224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313254:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee129500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588036224:12345-0@lo:400:kworker.0 Request processed in 30us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313260:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783967264.313270:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783967264.313275:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588036736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313304:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588036736:12345-0@lo:400:kworker.0 Request processed in 29us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313310:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783967264.313335:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037120 00000100:00100000:0.0:1783967264.313338:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037120 00000100:00100000:0.0:1783967264.313356:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036608 00000100:00100000:0.0:1783967264.313358:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036608 00000100:00100000:0.0:1783967264.313367:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037248 00000100:00100000:0.0:1783967264.313369:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037248 00000100:00100000:0.0:1783967264.313383:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037376 00000100:00100000:0.0:1783967264.313385:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037376 00000100:00100000:0.0:1783967264.313400:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783967264.313406:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588037120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313437:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588037120:12345-0@lo:400:kworker.0 Request processed in 31us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313443:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783967264.313452:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967264.313457:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588036608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313479:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588036608:12345-0@lo:400:kworker.0 Request processed in 21us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313485:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967264.313496:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783967264.313501:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624588037248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313526:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624588037248:12345-0@lo:400:kworker.0 Request processed in 25us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313532:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783967264.313544:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783967264.313550:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624588037376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967264.313594:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624588037376:12345-0@lo:400:kworker.0 Request processed in 44us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.313608:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783967264.313640:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967264.313644:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783967264.313648:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967264.313668:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588036352:0@lo:8:kworker.0 00000100:00100000:0.0:1783967264.313714:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.313746:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588036480:0@lo:8:kworker.0 00000100:00100000:0.0:1783967264.313792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.313819:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588036992:0@lo:8:kworker.0 00000100:00100000:0.0:1783967264.313840:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.313870:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036352 00000100:00100000:0.0:1783967264.313875:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036352 00000100:00100000:0.0:1783967264.313890:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036480 00000100:00100000:0.0:1783967264.313893:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036480 00000100:00100000:0.0:1783967264.313901:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036992 00000100:00100000:0.0:1783967264.313903:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036992 00000100:00100000:0.0:1783967264.313910:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967264.313916:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588036352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783967264.313944:0:24170:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:0.0:1783967264.313979:0:24170:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316068af5 00002000:00100000:0.0:1783967264.313996:0:24170:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a05c810b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783967264.314001:0:24170:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783967264.314004:0:24170:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783967264.314091:0:24170:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783967264.314119:0:24170:0:(import.c:65:import_set_state_nolock()) ffff9a05c9dee000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967264.314155:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624588036352:12345-0@lo:8:kworker.0 Request processed in 238us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967264.314171:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967264.314182:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967264.314186:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588036480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783967264.314197:0:24170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967264.314221:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588036480:12345-0@lo:8:kworker.0 Request processed in 34us (452us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967264.314227:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967264.314235:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967264.314239:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588036992:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783967264.314248:0:24170:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783967264.314264:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588036992:12345-0@lo:8:kworker.0 Request processed in 24us (423us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783967264.314270:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967264.314316:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588036736:0@lo:400:kworker.0 00010000:00080000:0.0:1783967264.314332:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba10700 x1870624588037376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.314343:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624588037376:0@lo:400:kworker.0 00010000:00080000:0.0:1783967264.314353:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba11180 x1870624588036608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.314362:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588036608:0@lo:400:kworker.0 00010000:00080000:0.0:1783967264.314372:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba10380 x1870624588037248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.314381:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624588037248:0@lo:400:kworker.0 00010000:00080000:0.0:1783967264.314441:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba11c00 x1870624588036352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.314450:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783967264.314457:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783967264.314466:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783967264.314472:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783967264.314475:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783967264.314492:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783967264.314497:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588036352:0@lo:8:kworker.0 00000100:00080000:0.0:1783967264.314508:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967264.314512:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967264.314516:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588036480:0@lo:8:kworker.0 00000100:00080000:0.0:1783967264.314524:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783967264.314529:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783967264.314532:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588036992:0@lo:8:kworker.0 00000100:00100000:0.0:1783967264.314557:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588037504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967264.314584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783967264.314605:0:22687:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:0.0:1783967264.314612:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588036224:0@lo:400:kworker.0 00010000:00080000:0.0:1783967264.314625:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba13480 x1870624588037120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967264.314633:0:22687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22687:1870624588037632:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783967264.314638:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588037120:0@lo:400:kworker.0 00010000:00080000:0.0:1783967264.314653:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05fba12680 x1870624588036864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783967280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967264.314674:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967264.314675:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588036864:0@lo:400:kworker.0 00000100:00100000:2.0:1783967264.314714:0:22687:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783967264.314733:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037504 00000100:00100000:2.0:1783967264.314738:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037504 00000100:00100000:3.0:1783967264.314874:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588036096 00000100:00100000:3.0:1783967264.314880:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588036096 00000100:00100000:2.0:1783967264.314880:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967264.314892:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624588037504:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783967264.314949:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783967264.315150:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967264.315210:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624588037504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 319us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967264.315218:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783967264.315247:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037632 00000100:00100000:2.0:1783967264.315251:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037632 00000100:00100000:2.0:1783967264.315274:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783967264.315280:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22687:x1870624588037632:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:0.0:1783967264.315329:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c372a300 x1870624588037504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967264.315347:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588037504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967264.315436:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783967264.315444:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:3645:x1870624588036096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967264.315486:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:3645:x1870624588036096:12345-0@lo:400:kworker.0 Request processed in 43us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967264.315493:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783967264.315548:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588036096:0@lo:400:kworker.0 00000004:00080000:0.0:1783967264.316851:0:22686:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783967264.316966:0:22686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 740518195365ns, next at 0ns, rc = 0 00080000:00080000:0.0:1783967264.316974:0:22686:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:2.0:1783967264.317338:0:24170:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1783967264.318295:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1783967264.318308:0:24170:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:3.0:1783967264.321596:0:22642:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1783967264.324542:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.324556:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.324579:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.324584:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.324592:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.324628:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.324641:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.324649:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.324735:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967264.325469:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967264.325478:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.325490:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967264.325497:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.325508:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.325533:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.325552:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068afc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.325573:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.325575:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.325576:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.326755:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.332083:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.332119:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.332125:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.332134:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.332156:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.332170:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.332201:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.332226:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.332357:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.332367:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.332378:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.332383:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.332393:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.332419:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.332427:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f5dfd34/0x9269c8b316068b03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.332466:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.332468:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.332471:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.333296:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.333304:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.333315:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.333318:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.333322:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.333329:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.333335:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.333340:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.333730:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.333985:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.333993:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.334002:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.334007:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.334015:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.334030:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.334038:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000623d32a/0x9269c8b316068b0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.334055:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.334056:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.334058:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.335133:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.335146:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335171:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.335176:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.335184:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335200:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335210:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335218:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335256:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967264.335285:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967264.335294:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.335305:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967264.335311:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.335321:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.335339:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.335348:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0569f1e/0x9269c8b316068b11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.335365:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.335368:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.335370:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.335899:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.335907:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335918:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.335922:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.335927:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.335936:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.336445:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.336454:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.336476:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.336722:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.336730:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.336752:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.336756:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.336766:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.336813:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.336823:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068b18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.336845:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.336847:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.336850:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.337206:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.337213:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.337223:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.337227:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.337233:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.337258:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.337268:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.337276:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.337315:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967264.337676:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967264.337684:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.337706:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967264.337710:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.337719:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.337732:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.337740:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d27d996/0x9269c8b316068b1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.337760:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.337762:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.337931:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.340491:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.340511:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.340536:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.340543:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.340552:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.340586:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.340599:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.340608:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.340723:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.340813:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.340830:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.340840:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.340848:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.340859:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.340885:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.340894:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.340923:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.340925:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.340927:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.341505:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.341513:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341525:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.341530:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.341536:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341548:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341557:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341577:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341599:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967264.341612:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967264.341618:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341626:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967264.341631:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341721:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341737:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341746:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.341804:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.341807:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.341810:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.342338:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.342411:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.342424:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.342429:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.342434:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.342446:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.342455:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.342463:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.342488:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783967264.343253:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.343264:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.343278:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.343282:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.343288:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.343301:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.343321:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.343329:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.343424:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783967264.344535:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.344554:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.344573:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.344577:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.344585:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.344599:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.344610:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.344618:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.348803:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783967264.348833:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783967264.348835:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967264.348857:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.348858:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.348913:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967264.348915:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.348924:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.348926:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.348970:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.348973:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349001:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349013:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.349020:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.349031:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349044:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967264.349051:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349061:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967264.349065:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.349076:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.349080:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.349094:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349109:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349117:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.349139:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.349141:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967264.349143:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.349697:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.350023:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.350034:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.350051:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.350056:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.350063:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.350076:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.350084:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.350099:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.350112:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783967264.351701:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.351714:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.351730:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.351734:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.351742:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.351756:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.351766:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.351801:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.351841:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783967264.352489:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783967264.352499:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352510:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.352515:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352540:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352560:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352569:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783967264.352578:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.352597:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.352615:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=740s v=(0 0) 00010000:00010000:0.0:1783967264.352623:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.352630:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352643:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.352648:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.352649:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.352665:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352668:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.352711:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352715:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.352747:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352748:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068b50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.352813:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352824:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.352831:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.352835:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.352844:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783967264.352845:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.352854:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352878:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352894:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352902:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068b57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.352922:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.352925:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.352927:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.352939:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.353449:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.353456:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.355488:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.355501:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.355632:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.355638:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.355645:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.355662:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.355674:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.355682:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.355718:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.356021:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.356028:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.356038:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.356043:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.356051:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.356068:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.356084:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068b5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.356107:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.356109:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.356111:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.359741:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.359806:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.359841:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.359846:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.359854:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.359871:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.359882:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.359891:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.359915:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.360309:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.360316:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.360326:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.360331:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.360340:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.360364:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.360373:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.360394:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.360396:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.360398:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.361552:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.361565:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.361580:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.361584:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.361591:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.361605:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.361633:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.361642:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.361684:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.362129:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.362137:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.362147:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.362152:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.362161:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.362176:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.362182:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.362202:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.362203:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.362205:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.363617:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.363629:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.363643:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.363647:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.363654:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.363684:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.363702:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.363709:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.363761:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.364139:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.364147:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.364155:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.364160:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.364181:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.364208:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.364217:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068b73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.364236:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.364239:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.364241:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.367236:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.367250:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.367269:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.367274:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.367280:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.368269:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.368379:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.368391:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.368424:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.368894:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.368902:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.368911:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.368916:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.368924:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.368955:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.368982:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6cd4e0/0x9269c8b316068b7a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.369006:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.369008:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.369019:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.370237:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.370247:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.370261:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.370279:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.370614:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.370630:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.370639:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.370645:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.370861:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.371416:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.371424:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.371434:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.371585:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.371609:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.371626:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.371633:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb9e1e2/0x9269c8b316068b81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.371655:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.371656:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.371658:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.376393:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.376416:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.376441:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.376447:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.376456:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.376473:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.376485:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.376501:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.376526:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.376570:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.376585:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.376601:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.376607:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.376619:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.376641:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.376650:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068b88 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.376704:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.376708:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.376710:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.378984:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.379003:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.379025:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.379031:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.379039:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.379055:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.379066:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.379075:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.379109:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.379150:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.379166:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.379183:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.379189:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.379200:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.379227:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.379236:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068b8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.379272:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.379274:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.379277:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.381219:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.381236:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.381267:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.381271:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.381279:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.381295:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.381306:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.381313:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.381344:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.381717:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.381728:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.381736:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.381742:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.381752:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.381802:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.381825:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066c4ca69/0x9269c8b316068b96 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.381850:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.381853:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.381855:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.386656:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.386677:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.386714:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.386720:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.386729:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.386747:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.386759:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.386801:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.386829:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.387238:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.387247:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.387257:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.387263:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.387274:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.387298:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.387307:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8d0e8a8/0x9269c8b316068b9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.387329:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.387331:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.387333:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.388664:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.388678:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.388706:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.388711:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.388719:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.388733:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.388742:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.388750:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.389315:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.390439:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.390449:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.390461:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.390465:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.390497:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.390521:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.390530:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca84870/0x9269c8b316068ba4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.390552:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.390554:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.390556:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.395822:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.395840:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.395871:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.395877:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.395887:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.395908:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.395922:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.395931:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.395954:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967264.396409:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967264.396418:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.396429:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967264.396436:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.396447:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.396469:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.396478:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753b516a/0x9269c8b316068bab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967264.396495:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.396497:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967264.396499:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967264.397980:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967264.397995:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.398012:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=740s v=(0 0) 00010000:00010000:2.0:1783967264.398017:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967264.398025:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.398044:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.398067:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967264.398076:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.400839:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.400863:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.400877:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.400894:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.400900:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.400912:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.400939:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.400960:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e7cf6/0x9269c8b316068bb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.400986:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.400988:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.400990:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.402037:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.402060:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.402079:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.402085:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.402093:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.402225:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.402247:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.402256:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.402281:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.402362:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.402371:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.402382:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.402387:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.402397:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.402414:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.402422:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb4ff90a/0x9269c8b316068bb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.402459:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.402461:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.402463:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.402992:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.403001:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403011:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.403014:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.403018:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403028:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403036:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403043:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403211:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.403420:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.403427:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403436:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.403440:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403449:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403463:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403471:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df5bbac8/0x9269c8b316068bc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403488:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.403490:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.403491:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.403549:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.403555:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403565:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.403568:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.403571:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403580:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403587:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403594:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403612:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967264.403650:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.403658:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403666:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.403669:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403756:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403864:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403874:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316068bc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.403893:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.403895:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.403896:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967264.403983:0:24170:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967264.403990:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.403998:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=740s v=(0 0) 00010000:00010000:3.0:1783967264.404007:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967264.404012:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.404021:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.404029:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.404036:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967264.404166:0:24170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783967264.404205:0:24170:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00010000:00010000:1.0:1783967264.404397:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967264.404415:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.404424:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967264.404428:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.404437:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.404449:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.404470:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316068bce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967264.404486:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.404488:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967264.404490:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967264.404544:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22687:x1870624588037632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89258us (89866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967264.404557:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783967264.407528:0:22687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22687:1870624588037632:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783967264.407557:0:22687:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1783967264.407622:0:22687:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22687:1870624588037760:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783967264.408237:0:22687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967264.408362:0:22687:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed231840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967264.415502:0:24472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037760 00000100:00100000:1.0:1783967264.415525:0:24472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037760 00000100:00100000:1.0:1783967264.415613:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967264.415627:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22687:x1870624588037760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783967264.415701:0:24472:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000020:00000004:0.0:1783967264.427382:0:24589:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967264.427629:0:24589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:3.0:1783967264.447010:0:24165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1783967264.447110:0:24165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783967264.449431:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22687:x1870624588037760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 33794us (41183us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1783967264.449453:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967264.449865:0:22687:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1783967264.449878:0:22687:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22687:1870624588037760:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783967264.449901:0:22687:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1783967265.336021:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1783967265.550433:0:24640:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967265.550876:0:24640:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1783967266.360258:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967267.384260:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967267.703068:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588037888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967267.703196:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967267.703423:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588037888 00000100:00100000:2.0:1783967267.703434:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588037888 00000100:00100000:2.0:1783967267.703521:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783967267.703546:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588037888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1783967267.703590:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967267.703662:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588037888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967267.703670:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783967267.703757:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588037888:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783967267.704357:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783967268.407956:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967268.730081:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588038016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967268.730187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967268.730299:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038016 00000100:00100000:0.0:1783967268.730309:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038016 00000100:00100000:0.0:1783967268.731933:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783967268.731956:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588038016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967268.732006:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967268.732092:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588038016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 148us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967268.732101:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783967268.732175:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588038016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967268.732543:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588038144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967268.732591:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967268.732654:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038144 00000100:00100000:2.0:1783967268.732662:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038144 00000100:00100000:2.0:1783967268.732700:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783967268.732708:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588038144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967268.732733:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783967268.732788:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588038144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967268.732795:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783967268.733022:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588038144:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1783967269.437236:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967269.759141:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588038272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967269.759219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967269.759294:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038272 00000100:00100000:3.0:1783967269.759302:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038272 00000100:00100000:3.0:1783967269.759355:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783967269.759363:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588038272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783967269.759389:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1783967269.759434:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588038272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967269.759441:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783967269.759462:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967269.759497:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588038272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783967269.759836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967269.759840:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967269.759843:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967269.759848:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 740 00000100:00080000:1.0:1783967269.759852:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783967269.759856:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967269.759878:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c370a300 x1870624588038656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783967269.759926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783967269.759929:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783967269.759930:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783967269.759934:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 740 00000100:00080000:1.0:1783967269.759936:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1783967269.759940:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:1.0:1783967269.759951:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a04c3708a80 x1870624588039168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783967269.760112:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588038400:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760174:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588039040:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760199:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760219:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783967269.760225:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588038912:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760252:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760271:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588039552:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760327:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588038528:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760352:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760369:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588039296:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760407:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783967269.760414:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588038784:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760446:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760465:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624588039424:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760487:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760512:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588038656:0@lo:8:kworker.0 00000100:00100000:1.0:1783967269.760547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760561:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588039168:0@lo:8:kworker.0 00000100:00100000:1.0:1783967269.760580:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967269.760626:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038400 00000100:00100000:1.0:1783967269.760632:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038400 00000100:00100000:1.0:1783967269.760666:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783967269.760674:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:3646:x1870624588038400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760708:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:3646:x1870624588038400:12345-0@lo:400:kworker.0 Request processed in 34us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.760715:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783967269.760742:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039040 00000100:00100000:1.0:1783967269.760745:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039040 00000100:00100000:1.0:1783967269.760792:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038656 00000100:00100000:1.0:1783967269.760795:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038656 00000100:00100000:1.0:1783967269.760804:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039168 00000100:00100000:1.0:1783967269.760806:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039168 00000100:00100000:1.0:1783967269.760813:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967269.760819:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588039040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.760846:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588039040:12345-0@lo:400:kworker.0 Request processed in 27us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.760852:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783967269.760861:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967269.760865:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588038656:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783967269.760887:0:24169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783967269.760913:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588038656:12345-0@lo:8:kworker.0 Request processed in 47us (365us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783967269.760919:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967269.760930:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967269.760933:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588039168:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783967269.760942:0:24169:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783967269.760960:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1870624588039168:12345-0@lo:8:kworker.0 Request processed in 25us (379us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783967269.760965:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783967269.760979:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038912 00000100:00100000:1.0:1783967269.760982:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038912 00000100:00100000:1.0:1783967269.761000:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038528 00000100:00100000:1.0:1783967269.761002:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038528 00000100:00100000:1.0:1783967269.761013:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783967269.761018:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588038912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761047:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588038912:12345-0@lo:400:kworker.0 Request processed in 28us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.761053:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783967269.761064:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967269.761069:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588038528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761096:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588038528:12345-0@lo:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.761101:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967269.761115:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039552 00000100:00100000:1.0:1783967269.761118:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039552 00000100:00100000:1.0:1783967269.761143:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039296 00000100:00100000:1.0:1783967269.761146:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039296 00000100:00100000:1.0:1783967269.761155:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588038784 00000100:00100000:1.0:1783967269.761158:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588038784 00000100:00100000:1.0:1783967269.761166:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039424 00000100:00100000:1.0:1783967269.761168:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039424 00000100:00100000:1.0:1783967269.761181:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967269.761186:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588039552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761215:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588039552:12345-0@lo:400:kworker.0 Request processed in 29us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.761221:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967269.761233:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783967269.761239:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588039296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761261:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588039296:12345-0@lo:400:kworker.0 Request processed in 22us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.761267:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783967269.761276:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967269.761281:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588038784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761304:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588038784:12345-0@lo:400:kworker.0 Request processed in 22us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.761310:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967269.761320:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967269.761326:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624588039424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761351:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624588039424:12345-0@lo:400:kworker.0 Request processed in 25us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967269.761357:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967269.761408:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588038912:0@lo:400:kworker.0 00010000:00080000:1.0:1783967269.761429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3709c00 x1870624588039552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967269.761439:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588039552:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761449:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588038400:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761458:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588039040:0@lo:400:kworker.0 00000100:00080000:1.0:1783967269.761484:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783967269.761488:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783967269.761491:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783967269.761508:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967269.761513:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967269.761516:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588038656:0@lo:8:kworker.0 00000100:00080000:1.0:1783967269.761524:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783967269.761527:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783967269.761530:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588039168:0@lo:8:kworker.0 00010000:00080000:1.0:1783967269.761557:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3709f80 x1870624588038784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967269.761566:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588038784:0@lo:400:kworker.0 00010000:00080000:1.0:1783967269.761577:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3708700 x1870624588039424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967269.761585:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624588039424:0@lo:400:kworker.0 00000100:00100000:1.0:1783967269.761612:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588038528:0@lo:400:kworker.0 00010000:00080000:1.0:1783967269.761623:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a04c3708000 x1870624588039296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967269.761638:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588039296:0@lo:400:kworker.0 00010000:00010000:1.0:1783967270.458113:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967270.844804:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783967271.479858:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783967271.991469:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783967272.504176:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967272.826364:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967272.826387:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588039680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1783967272.827657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967272.827710:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039680 00000100:00100000:1.0:1783967272.827719:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039680 00000100:00100000:1.0:1783967272.827788:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783967272.827798:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588039680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967272.827828:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1783967272.827875:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588039680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967272.827882:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783967272.827902:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967272.827950:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588039680:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783967273.533469:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783967273.654807:0:24985:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783967273.654811:0:24985:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783967273.654813:0:24985:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1783967273.654929:0:24985:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a04c3485800 00000020:01000004:3.0:1783967273.654948:0:24985:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783967273.654965:0:24985:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1783967273.654979:0:24985:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a05ea2399c0) 00000020:00000080:3.0:1783967273.654999:0:24985:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1783967273.698444:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1783967273.700276:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1783967273.700539:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1783967273.700745:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1783967273.701236:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1783967273.701453:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1783967273.701698:0:24985:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1783967273.702746:0:24985:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1783967273.703089:0:24985:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783967273.703104:0:24985:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783967273.703116:0:24985:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9269c8b316068bdc 00000020:01000004:3.0:1783967273.703123:0:24985:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1783967273.703144:0:24985:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.159@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783967273.703147:0:24985:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.159@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783967273.703153:0:24985:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783967273.703199:0:24985:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1783967273.703203:0:24985:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.159@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783967273.712176:0:24985:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.159@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783967273.712218:0:24985:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.159@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783967273.712223:0:24985:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783967273.712225:0:24985:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967273.712226:0:24985:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967273.712227:0:24985:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967273.712229:0:24985:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967273.712230:0:24985:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967273.712231:0:24985:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967273.712233:0:24985:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967273.712235:0:24985:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783967273.712240:0:24985:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783967273.712242:0:24985:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783967273.712244:0:24985:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967273.712245:0:24985:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967273.712246:0:24985:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967273.712247:0:24985:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967273.712248:0:24985:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967273.712249:0:24985:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967273.712250:0:24985:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967273.712251:0:24985:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783967273.712283:0:24985:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783967273.712308:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588039808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783967273.712386:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.712442:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54ac540 going to sleep for 11 seconds 00000100:00100000:1.0:1783967273.712470:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039808 00000100:00100000:1.0:1783967273.712478:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039808 00000100:00100000:1.0:1783967273.712547:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783967273.712556:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24985:x1870624588039808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783967273.712600:0:22657:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783967273.712603:0:22657:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783967273.712608:0:22657:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783967273.712990:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24985:x1870624588039808:12345-0@lo:253:mount.lustre.0 Request processed in 434us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.712999:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783967273.713216:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588039808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783967273.713229:0:24985:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783967273.713231:0:24985:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783967273.713233:0:24985:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967273.713234:0:24985:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967273.713236:0:24985:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967273.713237:0:24985:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967273.713238:0:24985:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967273.713239:0:24985:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967273.713246:0:24985:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967273.713247:0:24985:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783967273.713265:0:24985:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a04c3485800 from lustre-OST0001 10000000:01000000:3.0:1783967273.713296:0:24985:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783967273.713300:0:24985:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783967273.713308:0:24985:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a04c34799c0 local copy 00010000:00010000:3.0:1783967273.713319:0:24985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967273.713423:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588039936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967273.713455:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.713490:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967273.713502:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588039936 00000100:00100000:1.0:1783967273.713507:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588039936 00000100:00100000:1.0:1783967273.713551:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783967273.713558:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:24985:x1870624588039936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967273.713631:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:24985:x1870624588039936:12345-0@lo:501:mount.lustre.0 Request processed in 73us (174us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783967273.713638:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783967273.713803:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588039936:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783967273.713817:0:24985:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.159@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783967273.713837:0:24985:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.159@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783967273.713844:0:24985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.713853:0:24985:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602051e00/0x9269c8b316068816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b31606881d expref: -99 pid: 22641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967273.713875:0:24985:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a04c3485800 10000000:01000000:3.0:1783967273.713880:0:24985:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783967273.713885:0:24985:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783967273.713887:0:24985:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783967273.713891:0:24985:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783967273.713894:0:24985:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783967273.713916:0:24985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.713936:0:24985:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.713946:0:24985:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967273.713959:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967273.713984:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.714011:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967273.714498:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040064 00000100:00100000:1.0:1783967273.714504:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040064 00000100:00100000:1.0:1783967273.714551:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783967273.714559:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:24985:x1870624588040064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783967273.714569:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967273.714582:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068bea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068be3 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.714603:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068be3 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.714615:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0000/0x9269c8b316068bea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068be3 expref: 22 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.714624:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0000, rc 0) 00000100:00100000:1.0:1783967273.714666:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040064:12345-0@lo:101:mount.lustre.0 Request processed in 107us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.714674:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783967273.715462:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967273.715480:0:24985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068bea expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.715492:0:24985:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068bea expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967273.716909:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1783967273.718440:0:24985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967273.722701:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783967273.723476:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783967273.723530:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783967273.723548:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783967273.723560:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783967273.723572:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783967273.723585:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783967273.723596:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783967273.723610:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1783967273.723638:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1783967273.723643:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1783967273.724063:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967273.724144:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.724370:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967273.724461:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040192 00000100:00100000:1.0:1783967273.724468:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040192 00000100:00100000:1.0:1783967273.724553:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783967273.724563:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783967273.724741:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040192:12345-0@lo:501:mount.lustre.0 Request processed in 178us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.724749:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783967273.724849:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967273.724889:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967273.724928:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.725052:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334840 going to sleep for 11 seconds 00000100:00100000:3.0:1783967273.725139:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040320 00000100:00100000:3.0:1783967273.725144:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040320 00000100:00100000:3.0:1783967273.725169:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783967273.725187:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967273.726094:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040320:12345-0@lo:503:mount.lustre.0 Request processed in 914us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967273.726103:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783967273.726385:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783967273.727328:0:24985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783967273.727425:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967273.727494:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.727596:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334840 going to sleep for 11 seconds 00000100:00100000:0.0:1783967273.727838:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040448 00000100:00100000:0.0:1783967273.727845:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040448 00000100:00100000:3.0:1783967273.727939:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783967273.728029:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967273.728644:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040448:12345-0@lo:502:mount.lustre.0 Request processed in 695us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.728652:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783967273.728757:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040448:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967273.729078:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783967273.729109:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783967273.729123:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783967273.729136:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783967273.729151:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783967273.729164:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783967273.729229:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783967273.729246:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783967273.729256:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1783967273.729283:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967273.729323:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.729420:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967273.729520:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040576 00000100:00100000:1.0:1783967273.729526:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040576 00000100:00100000:1.0:1783967273.729570:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783967273.729578:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967273.729675:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040576:12345-0@lo:502:mount.lustre.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.729684:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783967273.729803:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967273.729865:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1783967273.729874:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1783967273.730727:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783967273.730735:0:24989:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1783967273.730742:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783967273.730745:0:24989:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783967273.730751:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783967273.731077:0:24989:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a04c24a19c0) 00000020:00000080:2.0:1783967273.731284:0:24989:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783967273.731292:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783967273.731430:0:24989:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c3485800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783967273.731440:0:24989:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783967273.731453:0:24989:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9269c8b316068bf8 00010000:00010000:2.0:1783967273.736675:0:24989:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1783967273.737255:0:24989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1783967273.739133:0:24989:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1783967273.741758:0:24989:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783967273.741794:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967273.741801:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.741803:0:24989:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783967273.741807:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967273.741811:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.741813:0:24989:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783967273.741816:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783967273.741818:0:24989:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783967273.741820:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967273.741822:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.741823:0:24989:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783967273.741826:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967273.741828:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.741835:0:24989:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783967273.741839:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1783967273.741872:0:24989:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967273.741875:0:24989:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.741876:0:24989:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783967273.741879:0:24989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1783967273.743423:0:24985:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783967273.743472:0:24985:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783967273.743699:0:24985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068bea expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.743713:0:24985:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0031200/0x9269c8b316068be3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068bea expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967273.743722:0:24985:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c3485800 from 1 10000000:01000000:3.0:1783967273.743725:0:24985:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783967273.743843:0:24985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.743852:0:24985:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.743864:0:24985:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967273.743888:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783967273.743956:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.743996:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967273.744395:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040704 00000100:00100000:0.0:1783967273.744402:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040704 00000100:00100000:0.0:1783967273.744457:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783967273.744467:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+22:24985:x1870624588040704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967273.744485:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967273.744499:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068bff expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967273.744535:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068bff expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967273.744546:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068bff expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967273.744555:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1800, rc 0) 00000100:00100000:0.0:1783967273.744621:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588040704:12345-0@lo:101:mount.lustre.0 Request processed in 154us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.744627:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783967273.744815:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783967273.744830:0:24985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.744838:0:24985:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783967273.746244:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1783967273.746607:0:24985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783967273.746802:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1783967273.746828:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1783967273.746843:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1783967273.746858:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1783967273.746871:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1783967273.746885:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1783967273.746897:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1783967273.746911:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1783967273.746925:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1783967273.746938:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1783967273.746950:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1783967273.747097:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1783967273.747105:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1783967273.747444:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967273.747520:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.747616:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967273.747677:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040832 00000100:00100000:0.0:1783967273.747684:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040832 00000100:00100000:0.0:1783967273.747796:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783967273.747806:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588040832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783967273.747936:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588040832:12345-0@lo:501:mount.lustre.0 Request processed in 131us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.747944:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783967273.748025:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967273.748059:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967273.748098:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.748282:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967273.748324:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588040960 00000100:00100000:2.0:1783967273.748328:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588040960 00000100:00100000:2.0:1783967273.748352:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783967273.750807:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588040960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967273.750971:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588040960:12345-0@lo:503:mount.lustre.0 Request processed in 2612us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.750981:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783967273.751898:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588040960:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783967273.752641:0:24985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783967273.752860:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967273.752929:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.752979:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3cb70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967273.753036:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041088 00000100:00100000:3.0:1783967273.753043:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041088 00000100:00100000:3.0:1783967273.753082:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783967273.753091:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588041088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967273.753199:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588041088:12345-0@lo:502:mount.lustre.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967273.753207:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783967273.753332:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967273.753542:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783967273.753567:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783967273.753582:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783967273.753594:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783967273.753605:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783967273.753634:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783967273.753649:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783967273.753662:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1783967273.753675:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783967273.753687:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1783967273.753699:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1783967273.753729:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041216:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967273.753765:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.753820:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3cb70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967273.753937:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041216 00000100:00100000:3.0:1783967273.753942:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041216 00000100:00100000:3.0:1783967273.753977:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783967273.753985:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588041216:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967273.754058:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588041216:12345-0@lo:502:mount.lustre.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967273.754065:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783967273.754726:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041216:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783967273.754824:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1783967273.754835:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1783967273.756535:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967273.756546:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967273.756548:0:24993:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783967273.756555:0:24993:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a04c3485800 00000020:00000080:0.0:1783967273.756558:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967273.756566:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967273.756569:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967273.756570:0:24993:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783967273.756572:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967273.756574:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967273.756576:0:24993:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783967273.756578:0:24993:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a04c3485800 00000020:00000080:0.0:1783967273.756580:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967273.756671:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783967273.756675:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967273.756677:0:24993:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783967273.756679:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783967273.756681:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783967273.756683:0:24993:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783967273.756686:0:24993:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a04c3485800 00000020:00000080:0.0:1783967273.756688:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783967273.756837:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967273.756977:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.756980:0:24993:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783967273.756985:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783967273.756988:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.756989:0:24993:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1783967273.756993:0:24993:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a04c3485800 00000020:00000080:1.0:1783967273.756995:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783967273.757029:0:24993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783967273.757033:0:24993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783967273.757034:0:24993:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1783967273.757037:0:24993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1783967273.758494:0:24985:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1783967273.758554:0:24985:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783967273.759074:0:24985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.759088:0:24985:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783967273.759151:0:24985:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783967273.759247:0:24985:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a04c3485800 10000000:01000000:2.0:1783967273.759250:0:24985:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a04c3485800 10000000:01000000:2.0:1783967273.759255:0:24985:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783967273.759261:0:24985:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a04c3485800 from 1 10000000:01000000:2.0:1783967273.759264:0:24985:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783967273.759302:0:24985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.759311:0:24985:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.759323:0:24985:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967273.759401:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783967273.759473:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967273.759834:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041344 00000100:00100000:0.0:1783967273.759841:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041344 00000100:00100000:0.0:1783967273.760082:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783967273.760091:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:24985:x1870624588041344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783967273.760105:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967273.760119:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1400/0x9269c8b316068c14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068c0d expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967273.760142:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1400/0x9269c8b316068c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068c0d expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967273.760229:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3cb7780 going to sleep for 11 seconds 00010000:00010000:0.0:1783967273.760264:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1400/0x9269c8b316068c14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068c0d expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967273.760275:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1400, rc 0) 00000100:00100000:0.0:1783967273.760319:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041344:12345-0@lo:101:mount.lustre.0 Request processed in 229us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.761537:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783967273.761564:0:24985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c14 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.761578:0:24985:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068c14 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783967273.763855:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1783967273.764132:0:24985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783967273.765585:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783967273.765621:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783967273.765635:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783967273.765648:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783967273.765660:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783967273.765674:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783967273.765686:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783967273.765697:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783967273.765708:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783967273.765738:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783967273.765756:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783967273.765788:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783967273.765805:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783967273.765819:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783967273.765837:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783967273.765850:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783967273.765861:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783967273.765872:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783967273.765884:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783967273.765898:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783967273.765923:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783967273.765935:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783967273.765947:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783967273.765959:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783967273.765970:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1783967273.765995:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1783967273.766010:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1783967273.766021:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1783967273.766032:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1783967273.766044:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1783967273.766055:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1783967273.766068:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1783967273.766081:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1783967273.766108:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1783967273.766121:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1783967273.766134:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1783967273.766148:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1783967273.766161:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1783967273.766172:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000100:00100000:0.0:1783967273.766473:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000040:00080000:2.0:1783967273.770661:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1783967273.770681:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1783967273.770715:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1783967273.770731:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1783967273.770745:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1783967273.770759:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1783967273.770791:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1783967273.770808:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1783967273.770821:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1783967273.770991:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1783967273.771012:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1783967273.771029:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1783967273.771034:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1783967273.771148:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783967273.771231:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.771283:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041472 00000100:00100000:2.0:1783967273.771290:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041472 00000100:00100000:2.0:1783967273.771338:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783967273.771348:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967273.773612:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c3cb7900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967273.774035:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041472:12345-0@lo:501:mount.lustre.0 Request processed in 2684us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.774047:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783967273.774158:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3729500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783967273.774476:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783967273.774536:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.774575:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed308600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967273.775487:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041600 00000100:00100000:2.0:1783967273.775497:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041600 00000100:00100000:2.0:1783967273.775562:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783967273.775570:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783967273.775707:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041600:12345-0@lo:503:mount.lustre.0 Request processed in 136us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.775715:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783967273.775839:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783967273.777640:0:24985:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783967273.777734:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967273.777840:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.777879:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54ac540 going to sleep for 11 seconds 00000100:00100000:2.0:1783967273.778613:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041728 00000100:00100000:2.0:1783967273.778622:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041728 00000100:00100000:2.0:1783967273.778677:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783967273.778687:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967273.778848:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041728:12345-0@lo:502:mount.lustre.0 Request processed in 162us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.778856:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783967273.779010:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967273.780348:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783967273.780463:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783967273.780480:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783967273.780494:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783967273.780508:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783967273.780534:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783967273.780551:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783967273.780561:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783967273.780574:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783967273.780585:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783967273.780599:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783967273.780611:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783967273.780624:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783967273.780637:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783967273.780650:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783967273.780664:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783967273.780694:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783967273.780708:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783967273.780719:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783967273.780731:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783967273.780743:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783967273.780753:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783967273.780764:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783967273.780801:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783967273.780816:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1783967273.780827:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1783967273.780841:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1783967273.780854:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1783967273.780884:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1783967273.780899:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1783967273.780913:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1783967273.780925:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1783967273.780948:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1783967273.780962:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1783967273.780975:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1783967273.780989:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1783967273.781000:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1783967273.781012:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1783967273.781024:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1783967273.781035:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1783967273.781047:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1783967273.781059:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1783967273.781071:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1783967273.781082:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1783967273.781108:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1783967273.781124:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1783967273.781138:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1783967273.781151:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1783967273.781893:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967273.781971:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.782053:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed308600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967273.788291:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041856 00000100:00100000:2.0:1783967273.788306:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041856 00000100:00100000:2.0:1783967273.789474:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783967273.789489:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783967273.789688:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041856:12345-0@lo:502:mount.lustre.0 Request processed in 203us (7717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.789697:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783967273.791105:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967273.791342:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1783967273.791374:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1783967273.791409:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783967273.791474:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.791850:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ed308600 going to sleep for 11 seconds 00000100:00100000:0.0:1783967273.795106:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588041984 00000100:00100000:0.0:1783967273.795120:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588041984 00000100:00100000:1.0:1783967273.795285:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783967273.795300:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783967273.795473:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588041984:12345-0@lo:502:mount.lustre.0 Request processed in 177us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.795482:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783967273.798861:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588041984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783967273.798957:0:24985:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1783967273.798972:0:24985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1783967273.803095:0:24999:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783967273.803115:0:24999:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a05f4f74d40) 00000020:00000080:2.0:1783967273.803141:0:24999:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1783967273.803964:0:24999:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c3485800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783967273.803972:0:24999:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a04c3485800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783967273.803975:0:24999:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c3485800 3 00010000:00080000:2.0:1783967273.804010:0:24999:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c3579800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.159@tcp at head 00010000:00010000:3.0:1783967273.811958:0:24999:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1783967273.812083:0:24999:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783967273.812133:0:24999:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783967273.812144:0:24999:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9269c8b316068c22 00000100:00080000:3.0:1783967273.812155:0:24999:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967273.812160:0:24999:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a04c3579800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967273.813830:0:24999:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e13b80 x1870624588042112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967273.813862:0:24999:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783967273.813935:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967273.813939:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967273.813942:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967273.813947:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 745 00000100:00080000:3.0:1783967273.813950:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783967273.813956:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967273.813982:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e11880 x1870624588042624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967273.814008:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967273.814010:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967273.814012:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967273.814015:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 745 00000100:00080000:3.0:1783967273.814017:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783967273.814021:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967273.814032:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05f7e13480 x1870624588043136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783967273.814073:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588042752:0@lo:400:kworker.0 00000100:00100000:3.0:1783967273.814148:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.814285:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624588043392:0@lo:400:kworker.0 00000100:00100000:3.0:1783967273.814316:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.814339:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783967273.814346:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588042496:0@lo:400:kworker.0 00000100:00100000:3.0:1783967273.814446:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.814465:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624588043264:0@lo:400:kworker.0 00000100:00100000:3.0:1783967273.814486:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.814686:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588042112:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967273.814723:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.814754:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588042624:0@lo:8:kworker.0 00000100:00100000:2.0:1783967273.814790:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.814806:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588043136:0@lo:8:kworker.0 00000100:00100000:2.0:1783967273.814824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1783967273.815224:0:24999:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783967273.815239:0:24999:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a04c24a0000) 00000020:00000080:3.0:1783967273.815263:0:24999:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1783967273.815837:0:24999:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a04c3485800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783967273.815841:0:24999:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a04c3485800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783967273.815844:0:24999:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a04c3485800 3 00010000:00080000:3.0:1783967273.815872:0:24999:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a04c3595800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.159@tcp at head 00000100:00100000:0.0:1783967273.819865:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042752 00000100:00100000:0.0:1783967273.819880:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042752 00000100:00100000:0.0:1783967273.819926:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043392 00000100:00100000:0.0:1783967273.819930:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043392 00000100:00100000:0.0:1783967273.819956:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043264 00000100:00100000:0.0:1783967273.819959:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043264 00000100:00100000:0.0:1783967273.819981:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042112 00000100:00100000:0.0:1783967273.819985:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042112 00000100:00100000:0.0:1783967273.820021:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783967273.820030:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588042752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.820156:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588042752:12345-0@lo:400:kworker.0 Request processed in 126us (6006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.820164:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783967273.820313:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783967273.820321:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624588043392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.820424:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624588043392:12345-0@lo:400:kworker.0 Request processed in 34us (6037us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.820432:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783967273.820446:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783967273.820452:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624588043264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.820482:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1870624588043264:12345-0@lo:400:kworker.0 Request processed in 30us (5995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.820488:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783967273.820499:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967273.820503:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588042112:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783967273.820591:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:0.0:1783967273.820631:0:22662:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9269c8b316068c30 00000004:00100000:0.0:1783967273.820649:0:22662:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783967273.820686:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9a05e9a0e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967273.820731:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1870624588042112:12345-0@lo:38:llog_process_th.0 Request processed in 226us (6007us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.820739:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967273.820800:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588042368:0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.820845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967273.820885:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588043008:0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.820908:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967273.820929:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783967273.820935:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588042240:0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.820962:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783967273.821251:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e12d80 x1870624588043264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967273.821266:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1870624588043264:0@lo:400:kworker.0 00010000:00080000:3.0:1783967273.821280:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e11180 x1870624588042752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967273.821287:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588042752:0@lo:400:kworker.0 00010000:00080000:3.0:1783967273.821297:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e10700 x1870624588043392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967273.821304:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624588043392:0@lo:400:kworker.0 00000100:00100000:3.0:1783967273.821333:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042496 00000100:00100000:3.0:1783967273.821345:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042496 00010000:00080000:2.0:1783967273.821746:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e13b80 x1870624588042112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967273.821755:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967273.821762:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00100000:0.0:1783967273.821887:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588042880:0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.821917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967273.821934:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624588043520:0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.821957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.822352:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042624 00000100:00100000:0.0:1783967273.822462:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043520 00000100:00100000:0.0:1783967273.822467:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043520 00000100:00100000:1.0:1783967273.822746:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043136 00000100:00100000:1.0:1783967273.822751:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043136 00000100:00100000:1.0:1783967273.822766:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043008 00000100:00100000:1.0:1783967273.822796:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043008 00000100:00100000:1.0:1783967273.822816:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967273.822825:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588042496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967273.822885:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588042496:12345-0@lo:400:kworker.0 Request processed in 61us (8439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.822893:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783967273.822920:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783967273.822925:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588043008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967273.822960:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588043008:12345-0@lo:400:kworker.0 Request processed in 35us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.822966:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783967273.823064:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042624 00000100:00100000:0.0:1783967273.823106:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783967273.823115:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624588043520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967273.823148:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1870624588043520:12345-0@lo:400:kworker.0 Request processed in 35us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.823154:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783967273.823284:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783967273.823290:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783967273.823294:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3579800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783967273.823301:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1870624588042112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783967273.823550:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967273.823557:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588043136:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783967273.823624:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588043136:12345-0@lo:8:kworker.0 Request processed in 66us (8798us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783967273.823631:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967273.823643:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783967273.823647:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588042624:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783967273.823681:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1870624588042624:12345-0@lo:8:kworker.0 Request processed in 33us (8890us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783967273.823687:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783967273.823735:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588042496:0@lo:400:kworker.0 00010000:00010000:3.0:1783967273.824670:0:24999:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1783967273.824792:0:24999:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1783967273.824834:0:24999:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783967273.824847:0:24999:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9269c8b316068c37 00000100:00080000:3.0:1783967273.824854:0:24999:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783967273.824859:0:24999:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a04c3595800 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967273.824889:0:24999:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2dce00 x1870624588043648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967273.824904:0:24999:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1783967273.825328:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624588043648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783967273.825404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.825461:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967273.825468:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967273.825472:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783967273.825475:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588042624:0@lo:8:kworker.0 00000100:00100000:2.0:1783967273.825486:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967273.825489:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783967273.825492:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783967273.825495:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588043136:0@lo:8:kworker.0 00000100:00100000:0.0:1783967273.825718:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043648 00000100:00100000:0.0:1783967273.825725:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043648 00000100:00100000:0.0:1783967273.825760:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967273.825795:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1870624588043648:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783967273.825827:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:0.0:1783967273.825872:0:22662:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9269c8b316068c3e 00000004:00100000:0.0:1783967273.825886:0:22662:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783967273.825917:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9a05e9a0c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967273.825980:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1870624588043648:12345-0@lo:38:llog_process_th.0 Request processed in 201us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967273.825996:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:3.0:1783967273.826216:0:24999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1783967273.826278:0:24985:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1783967273.826308:0:24985:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783967273.826321:0:24985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c14 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967273.826338:0:24985:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f5631200/0x9269c8b316068c0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c14 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783967273.826392:0:24985:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783967273.826394:0:24985:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967273.826396:0:24985:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967273.826397:0:24985:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967273.826398:0:24985:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967273.826399:0:24985:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967273.826401:0:24985:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967273.826403:0:24985:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967273.826404:0:24985:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783967273.826408:0:24985:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783967273.826410:0:24985:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783967273.826411:0:24985:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967273.826412:0:24985:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967273.826413:0:24985:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967273.826414:0:24985:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967273.826416:0:24985:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967273.826417:0:24985:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967273.826418:0:24985:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967273.826419:0:24985:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783967273.826436:0:24985:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783967273.826451:0:24985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588043776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783967273.826492:0:24985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.826531:0:24985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f54ac540 going to sleep for 11 seconds 00000100:00100000:3.0:1783967273.826549:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042240 00000100:00100000:3.0:1783967273.826554:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042240 00000100:00100000:3.0:1783967273.826581:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043776 00000100:00100000:3.0:1783967273.826584:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043776 00000100:00100000:3.0:1783967273.826595:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783967273.826601:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+25:3648:x1870624588042240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967273.826635:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+25:3648:x1870624588042240:12345-0@lo:400:kworker.0 Request processed in 34us (5672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967273.826647:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783967273.826670:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783967273.826675:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588043776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783967273.826694:0:22656:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783967273.826708:0:22656:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783967273.827760:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05ef2dce00 x1870624588043648/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783967283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967273.827820:0:3644:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783967273.827828:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1783967273.827837:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783967273.827842:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1783967273.827845:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c3595800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783967273.827851:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1870624588043648:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1783967273.827936:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1783967273.827942:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783967273.827944:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967273.828832:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042368 00000100:00100000:2.0:1783967273.828841:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042368 00000100:00100000:2.0:1783967273.828887:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588042880 00000100:00100000:2.0:1783967273.828890:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588042880 00000100:00100000:2.0:1783967273.828905:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783967273.828911:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588042368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967273.828990:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588042368:12345-0@lo:400:kworker.0 Request processed in 79us (8145us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.829008:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783967273.829021:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783967273.829026:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588042880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967273.829051:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588042880:12345-0@lo:400:kworker.0 Request processed in 25us (7134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.829057:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783967273.831323:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588042240:0@lo:400:kworker.0 00000100:00100000:1.0:1783967273.831342:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588042880:0@lo:400:kworker.0 00010000:00080000:1.0:1783967273.831578:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a05f7e10a80 x1870624588043520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967273.831591:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1870624588043520:0@lo:400:kworker.0 00000100:00100000:1.0:1783967273.831610:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588042368:0@lo:400:kworker.0 00000100:00100000:1.0:1783967273.831621:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588043008:0@lo:400:kworker.0 20000000:01000000:2.0:1783967273.837379:0:22656:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783967273.837401:0:22656:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783967273.837698:0:22678:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783967273.837704:0:22678:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783967273.837734:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.837757:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.837766:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.837793:0:22678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.837851:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.837865:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967273.837879:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588043904:0@lo:104: 00000100:00100000:1.0:1783967273.837944:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783967273.838004:0:22678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 24 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838012:0:22678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 24 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967273.838020:0:22678:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588044032:0@lo:104: 00000100:00100000:1.0:1783967273.838042:0:22678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967273.838058:0:22678:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c31c5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783967273.838085:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588043904 00000100:00100000:1.0:1783967273.838093:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588043904 00000100:00100000:1.0:1783967273.838128:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044032 00000100:00100000:1.0:1783967273.838130:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044032 00000100:00100000:1.0:1783967273.838145:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967273.838153:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+4:22678:x1870624588043904:12345-0@lo:104: 00010000:00010000:1.0:1783967273.838166:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838227:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783967273.838233:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+4:22678:x1870624588043904:12345-0@lo:104: Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.838246:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967273.838264:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967273.838270:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588044032:12345-0@lo:104: 00010000:00010000:1.0:1783967273.838278:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838312:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783967273.838317:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:22678:x1870624588044032:12345-0@lo:104: Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.838323:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967273.838599:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588043904:0@lo:104: 00000100:00100000:1.0:1783967273.838613:0:22678:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1f12300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22678:1870624588044032:0@lo:104: 00010000:00010000:1.0:1783967273.838633:0:22678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838651:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967273.838656:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838663:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967273.838667:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838674:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967273.838682:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967273.838695:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783967273.838750:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838757:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967273.838804:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838811:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0031600/0x9269c8b316068ae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068ae7 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838825:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967273.838828:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838834:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967273.838837:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838843:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967273.838849:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967273.838855:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783967273.838867:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838873:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967273.838896:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838903:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602051000/0x9269c8b316068ad2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068ad9 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.838916:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967273.838918:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967273.838920:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967273.838926:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967273.838942:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588044160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967273.839881:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588044288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967273.841273:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+24:24985:x1870624588043776:12345-0@lo:253:mount.lustre.0 Request processed in 14593us (14776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.841287:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783967273.841508:0:24985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:23275f43-9903-4089-8dbf-9caac6a945f7:24985:1870624588043776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783967273.841536:0:24985:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783967273.841540:0:24985:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783967273.841542:0:24985:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783967273.841543:0:24985:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783967273.841544:0:24985:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783967273.841545:0:24985:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783967273.841547:0:24985:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783967273.841548:0:24985:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783967273.841550:0:24985:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783967273.841551:0:24985:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783967273.841565:0:24985:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1783967273.843093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967273.843258:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044160 00000100:00100000:2.0:1783967273.843266:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044160 00010000:00010000:2.0:1783967273.843303:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967273.843343:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783967273.843352:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+24:3648:x1870624588044160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967273.843377:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967273.843383:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.843395:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.843411:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068ae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068ae0 expref: 24 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967273.843443:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967273.843524:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+23:3648:x1870624588044160:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967273.843531:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967273.843724:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588044160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783967273.846106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1783967273.846843:0:24985:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1783967273.849903:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044288 00000100:00100000:1.0:1783967273.849918:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044288 00010000:00010000:1.0:1783967273.850028:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 23 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967273.850181:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967273.850192:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23275f43-9903-4089-8dbf-9caac6a945f7+23:3645:x1870624588044288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967273.850211:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967273.850218:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 23 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850230:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 23 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850251:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1a00/0x9269c8b316068ad9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068ad2 expref: 23 pid: 22656 timeout: 850 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850282:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850291:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783967273.850311:0:22649:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012607107s 00010000:00010000:1.0:1783967273.850317:0:22649:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850324:0:22649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850332:0:22649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850339:0:22649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850345:0:22649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967273.850350:0:22649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850367:0:22649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850383:0:22649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.850394:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967273.850475:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23275f43-9903-4089-8dbf-9caac6a945f7+22:3645:x1870624588044288:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (4376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967273.850483:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967273.850598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588044416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967273.850642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.850687:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044416 00000100:00100000:3.0:1783967273.850692:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044416 00000100:00100000:3.0:1783967273.850724:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783967273.850732:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588044416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783967273.850764:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783967273.850851:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588044416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967273.850858:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783967273.850900:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588044416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967273.852018:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588044288:0@lo:103:ldlm_bl.0 00002000:00080000:3.0:1783967273.853120:0:24985:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783967273.853130:0:24985:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783967273.853183:0:24985:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783967273.853236:0:24985:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.159@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783967273.853257:0:24985:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1783967273.853281:0:24985:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1783967273.854680:0:24985:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00010000:00010000:1.0:1783967273.855091:0:22678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.855105:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967273.855112:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1c00/0x9269c8b316068c45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1783967273.855181:0:24985:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783967273.857582:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588044544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967273.857669:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967273.857964:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044544 00000100:00100000:3.0:1783967273.857973:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044544 00000100:00100000:3.0:1783967273.858031:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783967273.858041:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588044544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1783967273.858079:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783967273.858133:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588044544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967273.858141:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783967273.859643:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588044544:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1783967274.559310:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967274.872859:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967274.872883:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588044672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967274.872955:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967274.873039:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044672 00000100:00100000:0.0:1783967274.873049:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044672 00000100:00100000:0.0:1783967274.873107:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967274.873117:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588044672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783967274.873151:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1783967274.873196:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588044672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967274.873204:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783967274.874053:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588044672:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1783967275.103310:0:25052:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783967275.103894:0:25052:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783967275.575459:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783967275.768200:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783967275.768209:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a05c371f800 from 14 10000000:01000000:0.0:1783967275.768214:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783967275.768265:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.768277:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.768289:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967275.768315:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588044800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967275.768383:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967275.768433:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967275.769145:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044800 00000100:00100000:2.0:1783967275.769153:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044800 00000100:00100000:2.0:1783967275.769207:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783967275.769218:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588044800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967275.769231:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967275.769245:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631c00/0x9269c8b316068c53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068c4c expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967275.769268:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631c00/0x9269c8b316068c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068c4c expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967275.769278:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631c00/0x9269c8b316068c53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068c4c expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967275.769287:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631c00, rc 0) 00000100:00100000:2.0:1783967275.769334:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588044800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967275.769341:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783967275.771272:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588044800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967275.771298:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c53 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.771311:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068c53 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967275.771382:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588044928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783967275.771443:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967275.771495:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334600 going to sleep for 11 seconds 00000100:00100000:2.0:1783967275.771557:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588044928 00000100:00100000:2.0:1783967275.771564:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588044928 00000100:00100000:2.0:1783967275.771760:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783967275.771800:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588044928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783967275.771822:0:22656:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783967275.771841:0:22656:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783967275.771845:0:22656:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1783967275.771937:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588044928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967275.771946:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783967275.773194:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588044928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783967275.773269:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783967275.773278:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c53 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967275.773289:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df1600/0x9269c8b316068c4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c53 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967275.773299:0:22659:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783967275.773301:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a04c31ac800 from 14 10000000:01000000:1.0:1783967275.773304:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783967275.773333:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967275.773352:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967275.773361:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967275.773382:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588045056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783967275.773429:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967275.773466:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea657c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783967275.773544:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045056 00000100:00100000:0.0:1783967275.773550:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045056 00000100:00100000:0.0:1783967275.773603:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783967275.773613:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588045056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967275.773624:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967275.773638:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068c61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068c5a expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.773659:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068c5a expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.773670:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1c00/0x9269c8b316068c61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068c5a expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.773678:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1c00, rc 0) 00000100:00100000:0.0:1783967275.773714:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588045056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967275.773721:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783967275.773799:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588045056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967275.773811:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c61 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.773819:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068c61 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967275.773861:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588045184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783967275.773891:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967275.773904:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea334f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783967275.773916:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045184 00000100:00100000:0.0:1783967275.773919:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045184 00000100:00100000:0.0:1783967275.773936:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783967275.773941:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588045184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783967275.773954:0:22657:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783967275.773968:0:22657:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783967275.773971:0:22657:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1783967275.774112:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588045184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967275.774120:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1783967275.774146:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588045184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783967275.774186:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783967275.774192:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c61 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967275.774200:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f57d0c00/0x9269c8b316068c5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068c61 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967276.599448:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967277.624000:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967277.942985:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783967277.943023:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588045312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967277.943101:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967277.943352:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045312 00000100:00100000:0.0:1783967277.943360:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045312 00000100:00100000:0.0:1783967277.943452:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783967277.943462:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588045312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783967277.943494:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1783967277.943551:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588045312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967277.943558:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783967277.943656:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967277.944474:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588045312:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1783967278.649979:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783967278.968722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967278.968729:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967278.968733:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967278.968748:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a04c1f6f000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967278.968802:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2ddc00 x1870624588045824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783967278.968832:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783967278.968834:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783967278.968836:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783967278.968841:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a05f1a17000 using connection 192.168.204.159@tcp/0@lo 00000100:00100000:3.0:1783967278.968851:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a05ef2dd880 x1870624588046336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783967278.968955:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588045440:0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.969027:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969052:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624588045952:0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.969075:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588046080:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969116:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624588046592:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969141:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969160:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588047104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967278.969183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969230:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588045568:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969253:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969272:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588046208:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969308:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624588046848:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969344:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1783967278.969349:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588045696:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969366:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969382:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588046464:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969420:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969439:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624588046976:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.969493:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045952 00000100:00100000:3.0:1783967278.969501:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045952 00000100:00100000:3.0:1783967278.969541:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046592 00000100:00100000:3.0:1783967278.969543:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046592 00000100:00100000:3.0:1783967278.969569:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046848 00000100:00100000:3.0:1783967278.969572:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046848 00000100:00100000:3.0:1783967278.969583:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046464 00000100:00100000:3.0:1783967278.969585:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046464 00000100:00100000:3.0:1783967278.969593:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046976 00000100:00100000:3.0:1783967278.969596:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046976 00000100:00100000:3.0:1783967278.969610:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783967278.969618:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624588045952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969667:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624588045952:12345-0@lo:400:kworker.0 Request processed in 50us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967278.969674:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783967278.969689:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783967278.969695:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624588046592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969720:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624588046592:12345-0@lo:400:kworker.0 Request processed in 26us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967278.969726:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783967278.969736:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783967278.969742:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624588046848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.969786:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1870624588046848:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967278.969803:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783967278.969817:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783967278.969824:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588046464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967278.972879:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783967278.972903:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624588046976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.973380:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588046464:12345-0@lo:400:kworker.0 Request processed in 3554us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967278.973389:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1783967278.973432:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1783967278.973438:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967278.973494:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967278.973545:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588046720:0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.973584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967278.973991:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624588046976:12345-0@lo:400:kworker.0 Request processed in 1098us (4525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967278.973999:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783967278.974014:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046720 00000100:00100000:0.0:1783967278.974022:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046720 00000100:00100000:0.0:1783967278.974057:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783967278.974062:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588046720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967278.974092:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588046720:12345-0@lo:400:kworker.0 Request processed in 30us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967278.974098:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783967278.974120:0:24472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046208 00000100:00100000:0.0:1783967278.974124:0:24472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046208 00000100:00100000:0.0:1783967278.974151:0:24472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045696 00000100:00100000:0.0:1783967278.974153:0:24472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045696 00000100:00100000:0.0:1783967278.974173:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783967278.974178:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588046208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967278.974216:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588046208:12345-0@lo:400:kworker.0 Request processed in 38us (4921us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.974219:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588047232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967278.974227:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783967278.974239:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783967278.974244:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588045696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.974263:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967278.974282:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588045696:12345-0@lo:400:kworker.0 Request processed in 36us (4913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967278.974288:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783967278.974309:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2ddf80 x1870624588046720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967278.974314:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047104 00000100:00100000:0.0:1783967278.974319:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047104 00000100:00100000:0.0:1783967278.974337:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045568 00000100:00100000:0.0:1783967278.974340:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045568 00000100:00100000:2.0:1783967278.974342:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588046720:0@lo:400:kworker.0 00000100:00100000:0.0:1783967278.974349:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046080 00000100:00100000:0.0:1783967278.974352:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046080 00000100:00100000:0.0:1783967278.974365:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047232 00000100:00100000:0.0:1783967278.974368:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047232 00000100:00100000:0.0:1783967278.974380:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783967278.974387:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624588047104:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967278.974411:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588045824:0@lo:8:kworker.0 00000004:00000024:0.0:1783967278.974433:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967278.974455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967278.974474:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624588047104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (5289us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967278.974481:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783967278.974486:0:3644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588046336:0@lo:8:kworker.0 00000100:00100000:0.0:1783967278.974495:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967278.974502:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588045568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.974515:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967278.974552:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588045568:12345-0@lo:400:kworker.0 Request processed in 50us (5297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.974557:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045440 00000100:00100000:0.0:1783967278.974559:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783967278.974563:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045440 00000100:00100000:0.0:1783967278.974581:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783967278.974589:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1870624588046080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.974615:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783967278.974624:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3646:x1870624588046080:12345-0@lo:400:kworker.0 Request processed in 35us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.974628:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:3646:x1870624588045440:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783967278.974633:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967278.974636:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1783967278.974638:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967278.974648:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783967278.974655:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588047232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1783967278.974671:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967278.977747:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588045824 00000100:00100000:1.0:1783967278.977761:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588045824 00010000:00080000:3.0:1783967278.977858:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2df480 x1870624588045952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.977876:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624588045952:0@lo:400:kworker.0 00000100:00100000:1.0:1783967278.977935:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588046336 00000100:00100000:1.0:1783967278.977938:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588046336 00000100:00100000:1.0:1783967278.977949:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783967278.977955:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1870624588045824:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783967278.977992:0:24171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 755 last 0 00000020:00000080:1.0:1783967278.978021:0:24171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9269c8b316068c68 00002000:00100000:1.0:1783967278.978035:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a05fd51f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783967278.978039:0:24171:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783967278.978041:0:24171:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783967278.978209:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783967278.978233:0:24171:0:(import.c:65:import_set_state_nolock()) ffff9a05fd519800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967278.978801:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:3646:x1870624588045440:12345-0@lo:400:kworker.0 Request processed in 4174us (9771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.979057:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783967278.979594:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783967278.979601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dd180 x1870624588046592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.979702:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624588046592:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.979728:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588047104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967278.979788:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588045696:0@lo:400:kworker.0 00010000:00080000:3.0:1783967278.979802:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dfb80 x1870624588046464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.979811:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588046464:0@lo:400:kworker.0 00010000:00080000:3.0:1783967278.979823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2de300 x1870624588046976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.979853:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624588046976:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.979866:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588045568:0@lo:400:kworker.0 00000100:00100000:3.0:1783967278.979878:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588046208:0@lo:400:kworker.0 00010000:00080000:3.0:1783967278.979888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dea00 x1870624588046848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.979896:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1870624588046848:0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.979965:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1870624588046336:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783967278.979997:0:24472:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 755 last 0 00000100:00100000:1.0:1783967278.980019:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1870624588045824:12345-0@lo:8:kworker.0 Request processed in 2061us (5563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967278.980028:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:2.0:1783967278.980079:0:24472:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9269c8b316068c6f 00002000:00100000:2.0:1783967278.980208:0:24472:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a04c3579000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1783967278.980214:0:24472:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1783967278.980217:0:24472:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1783967278.980239:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2ddc00 x1870624588045824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783967278.980252:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1783967278.980260:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783967278.980266:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783967278.980269:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a04c1f6f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783967278.980279:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588047232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5622us (6015us total) trans 0 rc 0/0 00002000:00080000:2.0:1783967278.980283:0:24472:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000004:00080000:3.0:1783967278.980286:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783967278.980290:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783967278.980292:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1870624588045824:0@lo:8:kworker.0 00000100:00080000:2.0:1783967278.980381:0:24472:0:(import.c:65:import_set_state_nolock()) ffff9a04c357a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967278.980451:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1870624588046336:12345-0@lo:8:kworker.0 Request processed in 847us (5935us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.980458:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783967278.980488:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05ef2dd880 x1870624588046336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783967303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783967278.980500:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1783967278.980507:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783967278.980510:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783967278.980512:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a05f1a17000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783967278.980529:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:2.0:1783967278.980530:0:22689:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1783967278.980534:0:3644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1870624588046336:0@lo:8:kworker.0 00000100:00100000:2.0:1783967278.980559:0:22689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22689:1870624588047488:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783967278.980569:0:23406:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1783967278.980600:0:23406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1870624588047744:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783967278.980622:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1783967278.980651:0:23405:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783967278.980720:0:23405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 755181949623ns, next at 0ns, rc = 0 00080000:00080000:3.0:1783967278.980726:0:23405:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1783967278.980920:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588047616:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1783967278.980942:0:22689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8bc3780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967278.980954:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783967278.980958:0:22688:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1783967278.980981:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783967278.980988:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588047360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783967278.981013:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783967278.981014:0:22688:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 755182242664ns, next at 0ns, rc = 0 00080000:00080000:2.0:1783967278.981022:0:22688:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1783967278.981044:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967278.981061:0:23406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05cf0ecf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783967278.981667:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047616 00000100:00100000:3.0:1783967278.981674:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047616 00000100:00100000:3.0:1783967278.981713:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047360 00000100:00100000:3.0:1783967278.981716:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047360 00000100:00100000:3.0:1783967278.981732:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967278.981738:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588047616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1783967278.981762:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783967278.981831:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588047616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967278.981838:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783967278.981852:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967278.981858:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588047360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783967278.981867:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783967278.981890:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588047360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967278.981895:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783967278.981927:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047488 00000100:00100000:3.0:1783967278.981931:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047488 00000100:00100000:3.0:1783967278.981954:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047744 00000100:00100000:3.0:1783967278.981956:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047744 00000100:00100000:3.0:1783967278.981969:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783967278.981975:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22689:x1870624588047488:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783967278.982186:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783967278.982196:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23406:x1870624588047744:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1783967278.982258:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588047232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967278.982303:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588045440:0@lo:400:kworker.0 00000100:00100000:2.0:1783967278.982930:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588046080:0@lo:400:kworker.0 00000100:00080000:1.0:1783967278.983988:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1783967278.984577:0:22642:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:3.0:1783967278.984905:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05fba44380 x1870624588047360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.984927:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588047360:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1783967278.984940:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e13800 x1870624588047616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783967294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967278.984951:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588047616:0@lo:13:osp-pre-1-1.0 00002000:00080000:0.0:1783967278.987542:0:24169:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1783967278.987553:0:24169:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:0.0:1783967278.987560:0:24169:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00080000:2.0:1783967278.989586:0:24171:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1783967278.989600:0:24171:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000004:00080000:1.0:1783967278.989810:0:23395:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1783967278.990037:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23406:x1870624588047744:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7838us (8990us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.990048:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1783967278.998257:0:23406:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f7e13b80 x1870624588047744/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783967294 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967278.998278:0:23406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1870624588047744:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1783967278.998293:0:23406:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1783967278.998336:0:23406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1870624588047872:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1783967278.998399:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967278.998443:0:23406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c8139b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783967278.999570:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588047872 00000100:00100000:2.0:1783967278.999578:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588047872 00000100:00100000:2.0:1783967278.999643:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783967278.999654:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23406:x1870624588047872:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783967278.999688:0:24170:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1783967278.999751:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23406:x1870624588047872:12345-0@lo:5:osp-pre-1-1.0 Request processed in 99us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967278.999759:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1783967278.999817:0:23406:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c370aa00 x1870624588047872/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783967294 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967278.999842:0:23406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1870624588047872:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1783967278.999853:0:23406:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1783967278.999889:0:23406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1870624588048000:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1783967278.999934:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967278.999953:0:23406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8bc3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783967278.999966:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048000 00000100:00100000:2.0:1783967278.999969:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048000 00000100:00100000:2.0:1783967278.999986:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783967278.999989:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23406:x1870624588048000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1783967279.000010:0:24171:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:0.0:1783967279.003719:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.003734:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.003752:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.003757:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.003764:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.003810:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004224:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004243:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004265:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.004284:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.004290:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004299:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.004303:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004312:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004330:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004338:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068c76 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.004354:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.004356:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.004357:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.005392:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.005401:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.005589:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.005594:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.005601:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.005615:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.005625:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.005631:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.005655:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.005695:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.005702:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.005710:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.005714:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.005722:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.005736:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.005755:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da01ed17/0x9269c8b316068c7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.005790:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.005792:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.005794:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.006141:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.006148:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006156:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.006159:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.006163:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006172:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006181:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006188:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006213:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.006249:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.006255:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.006262:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.006266:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.006274:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.006286:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.006292:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000168b388/0x9269c8b316068c84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.006305:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.006307:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.006309:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.006741:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.006748:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006756:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.006760:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.006764:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006930:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006939:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006946:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.006968:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.007107:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.007114:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.007122:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.007126:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.007134:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.007148:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.007161:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c87c03b7/0x9269c8b316068c8b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.007176:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.007177:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.007179:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.007806:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.007813:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.007823:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.007827:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.007831:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.007840:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.007848:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.007866:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.007884:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.007896:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.007907:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.007914:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.007917:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.007925:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.007937:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.007944:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007300417d/0x9269c8b316068c92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.007958:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.007960:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.007962:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.008269:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.008275:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008284:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.008287:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.008291:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008300:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008308:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008315:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008337:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.008387:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.008393:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.008401:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.008404:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.008434:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.008445:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.008452:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000036b0a01/0x9269c8b316068c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.008466:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.008468:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.008470:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.008748:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.008754:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008793:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.008797:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.008802:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008812:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008820:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008827:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.008843:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.008967:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.008972:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.008980:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.008983:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.009002:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.009018:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.009024:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1d2055e/0x9269c8b316068ca0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.009039:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.009041:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.009042:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783967279.009306:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1783967279.009312:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.009321:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=755s v=(0 0) 00010000:00010000:1.0:1783967279.009323:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967279.009327:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.009337:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.009354:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.009361:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.009374:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.009527:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.009532:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.009540:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.009543:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.009550:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.009560:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.009577:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa6affbf/0x9269c8b316068ca7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.009590:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.009592:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.009593:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.011627:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.011641:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.011656:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.011661:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.011667:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.011678:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.011688:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.011696:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.011717:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.011999:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.012007:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.012015:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.012020:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.012029:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.012044:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.012063:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e20df331/0x9269c8b316068cae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.012079:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.012081:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.012082:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.012693:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.012709:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012718:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.012721:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.012726:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012735:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012743:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012750:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012766:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.012805:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.012811:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012818:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.012822:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012830:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012849:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012855:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.012868:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.012870:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.012872:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.014894:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.014910:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.014925:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.014929:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.014935:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.014948:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.014958:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.014965:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.014996:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.015226:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.015233:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.015242:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.015247:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.015256:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.015272:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.015281:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039b547e4/0x9269c8b316068cbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.015296:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.015298:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.015300:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.015752:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.015759:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.016276:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.016283:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.016290:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.016303:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.016313:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.016320:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.016335:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967279.016764:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.016786:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.016796:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.016800:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.016809:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.016823:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.016831:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000435539ce/0x9269c8b316068cc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.016848:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.016857:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.016859:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.016964:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.016970:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.016978:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.016987:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.016991:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.017000:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.017008:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.017014:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.017040:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967279.017586:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.017592:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.017601:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.017604:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.017687:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.017701:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.017708:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556a2d05/0x9269c8b316068cca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.017723:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.017725:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.017726:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.020005:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.020014:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020028:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.020031:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.020036:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020047:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020054:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020065:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020085:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.020117:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.020126:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.020135:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.020140:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.020149:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.020171:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.020179:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000881525/0x9269c8b316068cd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.020205:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.020207:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.020209:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.020814:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.020820:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020831:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.020834:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.020839:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020848:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020856:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020863:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.020884:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967279.020900:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.020906:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.020914:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1a00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.020917:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.020932:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.020943:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.020951:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000046c148/0x9269c8b316068cd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.020965:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.020967:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.020968:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.021692:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.021699:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.021717:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.021720:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.021724:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.021734:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.021743:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.021751:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.021792:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.022192:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.022198:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.022206:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.022210:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.022219:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.022231:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.022238:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c923b046/0x9269c8b316068cdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.022252:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.022253:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.022255:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967279.022981:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967279.022988:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.023008:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=755s v=(0 0) 00010000:00010000:2.0:1783967279.023011:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967279.023016:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.023027:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.023036:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.023044:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.023061:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.023278:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.023284:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.023292:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630c00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.023297:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.023305:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.023317:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.023325:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c1e7cf6/0x9269c8b316068ce6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.023340:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.023343:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.023344:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967279.024377:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967279.024386:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.024399:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=755s v=(0 0) 00010000:00010000:2.0:1783967279.024403:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967279.024408:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.024432:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.024452:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.024459:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.024482:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.024898:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.024905:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.024913:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.024917:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.024925:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.024952:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.024959:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0569f1e/0x9269c8b316068ced lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.024975:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.024977:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.024979:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967279.025510:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967279.025518:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.025527:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=755s v=(0 0) 00010000:00010000:2.0:1783967279.025530:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967279.025536:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.025546:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.025554:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.025562:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.025595:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783967279.025953:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783967279.025960:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.025968:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:3.0:1783967279.025972:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.025992:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.026005:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.026013:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f5dfd34/0x9269c8b316068cf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.026031:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.026033:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967279.026035:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783967279.027858:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1783967279.027868:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.027883:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=755s v=(0 0) 00010000:00010000:2.0:1783967279.027887:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967279.027893:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.027905:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.027915:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.027923:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.029751:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967279.029755:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.029763:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.029918:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.029923:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.029933:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.029952:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.029970:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000753b516a/0x9269c8b316068cfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.030061:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.030064:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.030066:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.031040:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.031050:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031065:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.031070:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.031076:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031090:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031099:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031118:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031134:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.031247:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.031253:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031261:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.031265:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031273:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031286:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031294:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9726148/0x9269c8b316068d02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.031308:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.031310:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.031311:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783967279.031984:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1783967279.031997:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032007:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=755s v=(0 0) 00010000:00010000:0.0:1783967279.032010:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783967279.032015:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032025:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032033:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032040:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032056:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.032161:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.032167:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032175:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.032179:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032188:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032205:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032212:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b50e2406/0x9269c8b316068d09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.032225:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.032227:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.032229:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.033194:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.033204:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033215:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.033219:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.033224:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033236:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033246:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033265:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033280:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783967279.033289:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783967279.033294:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.033301:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967279.033305:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.033312:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.033325:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.033332:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967279.033359:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.033361:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.033363:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.033814:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.033936:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033946:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.033950:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.033954:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033963:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033973:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.033980:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.034035:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967279.034141:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.034148:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.034156:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.034159:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.034168:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.034181:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.034189:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.034205:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.034206:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.034208:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.037523:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.037540:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.037563:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.037567:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.037574:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.037589:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.037600:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.037608:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.037636:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783967279.038969:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.038980:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.038994:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.038998:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.039003:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.039014:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.039036:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.039043:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.039065:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783967279.039100:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967279.039108:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039122:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.039127:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039135:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039154:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039162:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a8c2187/0x9269c8b316068d1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039182:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.039186:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039192:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.039195:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039203:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039213:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039225:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df5bbac8/0x9269c8b316068d25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.039240:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.039242:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.039244:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783967279.039276:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.040343:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.040353:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.040364:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.040368:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.040374:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.040384:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.040392:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.040398:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.040443:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783967279.041737:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967279.041747:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.041759:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967279.041764:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.041788:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.041807:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.041814:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4ff90a/0x9269c8b316068d2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967279.041832:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.041834:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967279.041835:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783967279.042352:0:24986:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1783967279.042385:0:24986:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1783967279.042391:0:24986:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783967279.042593:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23406:x1870624588048000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42597us (42654us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783967279.042603:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00002000:00010000:3.0:1783967279.042686:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.042694:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.042706:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.042710:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.042716:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.042727:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.042735:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.042743:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.042766:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.042937:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.042944:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.042958:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.042962:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.042970:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.042983:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.042991:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000134b87a9/0x9269c8b316068d33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043007:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.043009:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.043011:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.043210:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.043216:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043224:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.043232:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.043237:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043246:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043255:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043262:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043283:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.043376:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.043382:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043389:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030800 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.043392:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043400:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043435:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043443:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2b096a/0x9269c8b316068d3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043458:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.043460:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.043462:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.043541:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.043547:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043554:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.043557:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.043562:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043571:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043579:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043593:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043614:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.043667:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.043672:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043680:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.043683:0:22650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043691:0:22650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043703:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043710:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c98c7c/0x9269c8b316068d41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.043735:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.043737:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.043739:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783967279.043970:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.043976:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.043985:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.043988:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.043991:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044000:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044008:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044014:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044032:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.044080:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.044086:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.044094:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.044097:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.044104:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.044115:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.044123:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7252ff/0x9269c8b316068d48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.044136:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.044138:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.044140:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967279.044418:0:23406:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1783967279.044430:0:23406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba46680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23406:1870624588048000:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1783967279.044448:0:23406:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1783967279.044498:0:23406:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23406:1870624588048128:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1783967279.044548:0:23406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967279.044586:0:23406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05e08f9900 going to sleep for 11 seconds 00000100:00100000:2.0:1783967279.044606:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048128 00000100:00100000:2.0:1783967279.044612:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048128 00000100:00100000:2.0:1783967279.044661:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783967279.044678:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23406:x1870624588048128:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1783967279.044739:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23406:x1870624588048128:12345-0@lo:900:osp-pre-1-1.0 Request processed in 63us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967279.044746:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:3.0:1783967279.044750:0:24169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1783967279.044755:0:24169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1783967279.044813:0:23406:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c370ad80 x1870624588048128/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1783967295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967279.044825:0:23406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23406:1870624588048128:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1783967279.044882:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=755s v=(0 0) 00010000:00010000:3.0:1783967279.044886:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967279.044892:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044902:0:24169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044911:0:24169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044917:0:24169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967279.044929:0:24169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783967279.045511:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967279.045528:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.045537:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602179400 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967279.045542:0:22651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.045551:0:22651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.045565:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.045573:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ba4b3bb/0x9269c8b316068d4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967279.045589:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.045591:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967279.045592:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783967279.045804:0:24169:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1783967279.045864:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22689:x1870624588047488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 63887us (65241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967279.045873:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783967279.046002:0:22689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22689:1870624588047488:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783967279.046015:0:22689:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1783967279.046059:0:22689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22689:1870624588048256:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783967279.046141:0:22689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967279.046166:0:22689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c7ed13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967279.046223:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048256 00000100:00100000:0.0:1783967279.046229:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048256 00000100:00100000:0.0:1783967279.046293:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967279.046301:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22689:x1870624588048256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1783967279.046337:0:24170:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1783967279.048112:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22689:x1870624588048256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1807us (1965us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1783967279.048124:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783967279.049272:0:22689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba45880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22689:1870624588048256:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783967279.049290:0:22689:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1783967279.671631:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967279.991039:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588048384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783967279.991114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967279.991347:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048384 00000100:00100000:2.0:1783967279.991356:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048384 00000100:00100000:2.0:1783967279.991416:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967279.991427:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588048384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783967279.991455:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967279.991502:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588048384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967279.991510:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967279.991561:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588048384:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1783967280.055842:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1783967280.525934:0:25341:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg459-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783967280.698147:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783967281.208457:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1783967281.444459:0:25393:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1783967281.444688:0:25393:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1783967281.718941:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1783967282.443183:0:25444:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1783967282.444151:0:25444:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1783967282.741129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967282.741840:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811584 00000100:00100000:2.0:1783967282.741851:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811584 00000100:00100000:2.0:1783967282.741906:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 119 00000100:00100000:2.0:1783967282.741925:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2399:x1870624563811584:12345-192.168.204.59@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783967282.741961:0:22656:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 07861a25-7be1-4505-8a1a-db0e790c2e46@192.168.204.59@tcp t0 exp 0000000000000000 cur 758 last 0 00000020:00000080:2.0:1783967282.741994:0:22656:0:(genops.c:1406:class_connect()) connect: client 07861a25-7be1-4505-8a1a-db0e790c2e46, cookie 0x9269c8b316068d56 00000100:00080000:2.0:1783967282.742128:0:22656:0:(import.c:65:import_set_state_nolock()) ffff9a04c357c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783967282.742206:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+5:2399:x1870624563811584:12345-192.168.204.59@tcp:250:mount.lustre.0 Request processed in 290us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967282.742228:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 119 00010000:00010000:3.0:1783967282.742929:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967282.752215:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967282.752319:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811712 00000100:00100000:2.0:1783967282.752330:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811712 00000100:00100000:2.0:1783967282.752455:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:2.0:1783967282.752469:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+5:18108:x1870624563811712:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783967282.752487:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967282.752505:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631e00/0x9269c8b316068d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d71cd expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967282.752537:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631e00/0x9269c8b316068d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71cd expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967282.752549:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631e00/0x9269c8b316068d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71cd expref: 6 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967282.752558:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631e00, rc 0) 00000100:00100000:2.0:1783967282.752624:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+6:18108:x1870624563811712:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 158us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967282.752631:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 120 00000100:00100000:1.0:1783967282.763076:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967282.763232:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811840 00000100:00100000:0.0:1783967282.763243:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811840 00000100:00100000:0.0:1783967282.763308:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:0.0:1783967282.763320:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+6:18108:x1870624563811840:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783967282.763456:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+6:18108:x1870624563811840:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 138us (391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783967282.763464:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 121 00000100:00100000:3.0:1783967282.770296:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967282.770644:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563811968 00000100:00100000:2.0:1783967282.770656:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563811968 00000100:00100000:2.0:1783967282.770972:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:2.0:1783967282.770986:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+6:18108:x1870624563811968:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783967282.771110:0:22655:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967282.771137:0:22655:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5630400/0x9269c8b316068d64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d71d4 expref: -99 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967282.771200:0:22655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5630400/0x9269c8b316068d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71d4 expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967282.771213:0:22655:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5630400/0x9269c8b316068d64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d71d4 expref: 7 pid: 22655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967282.771223:0:22655:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630400, rc 0) 00000100:00100000:2.0:1783967282.771678:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+7:18108:x1870624563811968:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 692us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967282.771687:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 122 00000100:00100000:3.0:1783967282.775089:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.775390:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812096 00000100:00100000:1.0:1783967282.775404:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812096 00000100:00100000:1.0:1783967282.775557:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:1.0:1783967282.775572:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+7:18108:x1870624563812096:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783967282.776080:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18108:x1870624563812096:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 436us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.776091:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 123 00000100:00100000:2.0:1783967282.778661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967282.778882:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812224 00000100:00100000:3.0:1783967282.778911:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812224 00000100:00100000:3.0:1783967282.778984:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:3.0:1783967282.778998:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18108:x1870624563812224:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783967282.779205:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18108:x1870624563812224:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 209us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.779214:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 124 00000100:00100000:2.0:1783967282.786485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967282.787429:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812352 00000100:00100000:3.0:1783967282.787443:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812352 00000100:00100000:2.0:1783967282.787988:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:2.0:1783967282.788011:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18126:x1870624563812352:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783967282.788264:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18126:x1870624563812352:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 264us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967282.788273:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 125 00000100:00100000:2.0:1783967282.816838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.816963:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812480 00000100:00100000:1.0:1783967282.816977:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812480 00000100:00100000:1.0:1783967282.817178:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:1.0:1783967282.817211:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18126:x1870624563812480:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967282.817466:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18126:x1870624563812480:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 257us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.817476:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 126 00000100:00100000:2.0:1783967282.819638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.820893:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812608 00000100:00100000:1.0:1783967282.820910:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812608 00000100:00100000:1.0:1783967282.820974:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:1.0:1783967282.820986:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18126:x1870624563812608:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967282.821291:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18126:x1870624563812608:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 307us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.821301:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 127 00000100:00100000:2.0:1783967282.825462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.825713:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812736 00000100:00100000:1.0:1783967282.825726:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812736 00000100:00100000:1.0:1783967282.825937:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:1.0:1783967282.825950:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+8:18108:x1870624563812736:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783967282.825973:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967282.825997:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0600/0x9269c8b316068d6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7205 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967282.826050:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0600/0x9269c8b316068d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7205 expref: 9 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967282.826064:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0600/0x9269c8b316068d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7205 expref: 9 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967282.826075:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0600, rc 0) 00000100:00100000:1.0:1783967282.826177:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+9:18108:x1870624563812736:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 229us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.826186:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 128 00000100:00100000:2.0:1783967282.829471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967282.829961:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812864 00000100:00100000:3.0:1783967282.829975:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812864 00000100:00100000:3.0:1783967282.830302:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:3.0:1783967282.830314:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+9:18108:x1870624563812864:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783967282.830435:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783967282.830466:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783967282.830470:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783967282.830473:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783967282.830476:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1783967282.830478:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1783967282.833754:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+9:18108:x1870624563812864:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 3425us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.833802:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 129 00000100:00100000:2.0:1783967282.837218:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.837441:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563812992 00000100:00100000:1.0:1783967282.837455:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563812992 00000100:00100000:1.0:1783967282.837666:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:1.0:1783967282.837680:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+9:18108:x1870624563812992:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783967282.837704:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967282.837730:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d720c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967282.837813:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967282.837828:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 10 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967282.837838:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1400, rc 0) 00000100:00100000:1.0:1783967282.837919:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18108:x1870624563812992:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 242us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.837927:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 130 00000100:00100000:2.0:1783967282.840584:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967282.840793:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813120 00000100:00100000:3.0:1783967282.840807:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813120 00000100:00100000:3.0:1783967282.840875:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:3.0:1783967282.840887:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18108:x1870624563813120:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783967282.841127:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18108:x1870624563813120:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 241us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.841161:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 131 00000100:00100000:3.0:1783967282.843767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967282.844051:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813248 00000100:00100000:0.0:1783967282.844063:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813248 00000100:00100000:0.0:1783967282.844134:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:0.0:1783967282.844146:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18108:x1870624563813248:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783967282.844516:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18108:x1870624563813248:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 370us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967282.844537:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 132 00000100:00100000:2.0:1783967282.848268:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967282.848954:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813376 00000100:00100000:0.0:1783967282.848976:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813376 00000100:00100000:0.0:1783967282.849119:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:0.0:1783967282.849131:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18131:x1870624563813376:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783967282.850103:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18131:x1870624563813376:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 967us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967282.850115:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 133 00000100:00100000:2.0:1783967282.853994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967282.854281:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813504 00000100:00100000:3.0:1783967282.854295:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813504 00000100:00100000:3.0:1783967282.854513:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:3.0:1783967282.854536:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18131:x1870624563813504:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967282.854756:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18131:x1870624563813504:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 232us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.854766:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 134 00000100:00100000:2.0:1783967282.864305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967282.864478:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967282.874867:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813632 00000100:00100000:0.0:1783967282.874889:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813632 00000100:00100000:0.0:1783967282.874963:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813888 00000100:00100000:0.0:1783967282.874967:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813888 00000100:00100000:0.0:1783967282.875012:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:0.0:1783967282.875024:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1870624563813632:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783967282.875064:0:24473:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f9eee701-2af2-4fba-9984-4e5f1861197d@192.168.204.59@tcp t0 exp 0000000000000000 cur 759 last 0 00000020:00000080:0.0:1783967282.875128:0:24473:0:(genops.c:1406:class_connect()) connect: client f9eee701-2af2-4fba-9984-4e5f1861197d, cookie 0x9269c8b316068d79 00000004:00100000:0.0:1783967282.875162:0:24473:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00100000:3.0:1783967282.875442:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1783967282.875450:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1870624563813888:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783967282.875471:0:22662:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from f9eee701-2af2-4fba-9984-4e5f1861197d@192.168.204.59@tcp t0 exp 0000000000000000 cur 759 last 0 00000020:00000080:3.0:1783967282.875517:0:22662:0:(genops.c:1406:class_connect()) connect: client f9eee701-2af2-4fba-9984-4e5f1861197d, cookie 0x9269c8b316068d80 00000004:00100000:3.0:1783967282.875545:0:22662:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:3.0:1783967282.875825:0:22662:0:(import.c:65:import_set_state_nolock()) ffff9a04c3591800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783967282.875932:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2399:x1870624563813888:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 481us (11454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.875942:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00080000:0.0:1783967282.876393:0:24473:0:(import.c:65:import_set_state_nolock()) ffff9a05e9a0b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967282.876426:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2399:x1870624563813632:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 1402us (12219us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967282.876458:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783967282.882214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967282.882693:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967282.886325:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814144 00000100:00100000:3.0:1783967282.886355:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814144 00000100:00100000:3.0:1783967282.886501:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814016 00000100:00100000:3.0:1783967282.886506:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814016 00000100:00080000:1.0:1783967282.886547:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967282.886553:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00080000:1.0:1783967282.886556:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783967282.886566:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814144:12345-192.168.204.59@tcp:41:mount.lustre.0 00000100:00100000:2.0:1783967282.886566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.890726:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1783967282.890758:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:0:x1870624563814016:12345-192.168.204.59@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783967282.890790:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563813760 00000100:00100000:0.0:1783967282.890803:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563813760 00000004:00000024:1.0:1783967282.890851:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967282.890990:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:0:x1870624563814016:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 248us (8299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.891022:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:1.0:1783967282.891044:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:1.0:1783967282.891051:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+7:0:x1870624563813760:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783967282.891072:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967282.891467:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+7:0:x1870624563813760:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 413us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.891475:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000004:00000024:3.0:1783967282.893551:0:22662:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1783967282.893717:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814144:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 7145us (11512us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.893728:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1783967282.899674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967282.899984:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814272 00000100:00100000:0.0:1783967282.899998:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814272 00000100:00100000:0.0:1783967282.900090:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:0.0:1783967282.900103:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814272:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783967282.900237:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814272:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 136us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967282.900246:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 12 00000100:00100000:2.0:1783967282.904490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967282.904717:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967282.905430:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814656 00000100:00100000:1.0:1783967282.905446:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814656 00000100:00100000:1.0:1783967282.905645:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:1.0:1783967282.905659:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814656:12345-192.168.204.59@tcp:900:mount.lustre.0 00000100:00100000:1.0:1783967282.905835:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814656:12345-192.168.204.59@tcp:900:mount.lustre.0 Request processed in 169us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.905844:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:0.0:1783967282.908431:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814400 00000100:00100000:0.0:1783967282.908456:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814400 00000100:00100000:0.0:1783967282.908541:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783967282.908554:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563814400:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783967282.908605:0:24171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f9eee701-2af2-4fba-9984-4e5f1861197d@192.168.204.59@tcp t0 exp 0000000000000000 cur 759 last 0 00000020:00000080:0.0:1783967282.910275:0:24171:0:(genops.c:1406:class_connect()) connect: client f9eee701-2af2-4fba-9984-4e5f1861197d, cookie 0x9269c8b316068d87 00002000:00100000:0.0:1783967282.910304:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f9eee701-2af2-4fba-9984-4e5f1861197d/ffff9a05c7474000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783967282.910417:0:24171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00000100:00100000:3.0:1783967282.910956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00002000:00080000:0.0:1783967282.911468:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783967282.911524:0:24171:0:(import.c:65:import_set_state_nolock()) ffff9a05c337a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967282.911627:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2399:x1870624563814400:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 3074us (7151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967282.911962:0:24472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814528 00000100:00100000:3.0:1783967282.911974:0:24472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814528 00000100:00100000:3.0:1783967282.912115:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783967282.912126:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1870624563814528:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783967282.912165:0:24472:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f9eee701-2af2-4fba-9984-4e5f1861197d@192.168.204.59@tcp t0 exp 0000000000000000 cur 759 last 0 00000020:00000080:3.0:1783967282.912203:0:24472:0:(genops.c:1406:class_connect()) connect: client f9eee701-2af2-4fba-9984-4e5f1861197d, cookie 0x9269c8b316068d8e 00002000:00100000:3.0:1783967282.912216:0:24472:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f9eee701-2af2-4fba-9984-4e5f1861197d/ffff9a04c3590000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783967282.912242:0:24472:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00000100:00100000:0.0:1783967282.912658:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00002000:00080000:0.0:1783967282.913523:0:24472:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783967282.913570:0:24472:0:(import.c:65:import_set_state_nolock()) ffff9a05c337d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783967282.913994:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2399:x1870624563814528:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 1864us (3038us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967282.914006:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783967282.914469:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967282.914618:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814784 00000100:00100000:0.0:1783967282.914765:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814784 00000100:00100000:0.0:1783967282.914849:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967282.914859:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814784:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783967282.920888:0:22665:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5907us 00000004:00200000:0.0:1783967282.934139:0:22665:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1783967282.934360:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18108:x1870624563814784:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 19483us (19874us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967282.934376:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967283.063109:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588048512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967283.063235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967283.063460:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048512 00000100:00100000:1.0:1783967283.063473:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048512 00000100:00100000:1.0:1783967283.063577:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967283.063589:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588048512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967283.063620:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00080000:2.0:1783967283.063721:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967283.073136:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588048512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9533us (9884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967283.073183:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783967283.078867:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588048512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967283.172207:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967283.172414:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563814912 00000100:00100000:0.0:1783967283.172427:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563814912 00000100:00100000:0.0:1783967283.172510:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:0.0:1783967283.172533:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18154:x1870624563814912:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:0.0:1783967283.172571:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967283.172608:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316068d95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d723d expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967283.172969:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068d9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967283.172991:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068d9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967283.173012:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068d9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783967283.173227:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1783967283.173232:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1783967283.173279:0:22664:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068d9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967283.173314:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0800/0x9269c8b316068d95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d723d expref: 8 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967283.173349:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068d9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d723d expref: 7 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967283.173361:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:0.0:1783967283.173365:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783967283.173369:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0e00, rc 0) 00000100:00100000:0.0:1783967283.173529:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18154:x1870624563814912:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 997us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967283.173538:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00010000:00010000:2.0:1783967283.767296:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967284.087190:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588048640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1783967284.087292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.087508:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048640 00000100:00100000:1.0:1783967284.087518:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048640 00000100:00100000:1.0:1783967284.087601:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783967284.087614:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588048640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967284.087662:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967284.087729:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588048640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.087738:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783967284.087841:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588048640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967284.088064:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588048768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967284.088108:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088281:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588049024:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967284.088348:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967284.088370:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588049536:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.088381:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967284.088408:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588049792:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088441:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588050048:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.088450:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967284.088474:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588050304:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088500:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1783967284.088508:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588048896:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.088543:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967284.088566:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1783967284.088574:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588049152:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088598:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588049408:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.088605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967284.088634:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588049664:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088661:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624588049920:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.088668:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967284.088696:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624588050176:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088729:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049792 00000100:00100000:1.0:1783967284.088735:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049792 00000100:00100000:0.0:1783967284.088736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967284.088794:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050048 00000100:00100000:1.0:1783967284.088805:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050048 00000100:00100000:1.0:1783967284.088832:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050304 00000100:00100000:1.0:1783967284.088834:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050304 00000100:00100000:1.0:1783967284.088847:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049408 00000100:00100000:1.0:1783967284.088849:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049408 00000100:00100000:1.0:1783967284.088858:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049920 00000100:00100000:1.0:1783967284.088861:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049920 00000100:00100000:1.0:1783967284.088872:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050176 00000100:00100000:1.0:1783967284.088875:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050176 00000100:00100000:1.0:1783967284.088889:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967284.088896:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588049792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.088943:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588049792:12345-0@lo:400:kworker.0 Request processed in 46us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.088950:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783967284.088965:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783967284.088971:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588050048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089000:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588050048:12345-0@lo:400:kworker.0 Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089007:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783967284.089019:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967284.089025:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588050304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.089054:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049024 00000100:00100000:1.0:1783967284.089055:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588050304:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967284.089061:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049024 00000100:00100000:1.0:1783967284.089066:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783967284.089080:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783967284.089088:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588049408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.089104:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783967284.089113:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588049024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089136:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588049408:12345-0@lo:400:kworker.0 Request processed in 48us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089166:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783967284.089179:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783967284.089185:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624588049920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.089224:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588049024:12345-0@lo:400:kworker.0 Request processed in 109us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089225:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1870624588049920:12345-0@lo:400:kworker.0 Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089240:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783967284.089243:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783967284.089257:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783967284.089264:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624588050176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.089284:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048896 00000100:00100000:0.0:1783967284.089290:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048896 00000100:00100000:1.0:1783967284.089292:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624588050176:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089300:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783967284.089341:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783967284.089351:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:3646:x1870624588048896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089355:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588049408:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089372:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1870624588049920:0@lo:400:kworker.0 00010000:00080000:1.0:1783967284.089388:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05fba11f80 x1870624588050048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967284.089394:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:3646:x1870624588048896:12345-0@lo:400:kworker.0 Request processed in 43us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967284.089410:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783967284.089412:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588050048:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089427:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588049024:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.089450:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049536 00000100:00100000:0.0:1783967284.089456:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049536 00000100:00100000:1.0:1783967284.089461:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:23275f43-9903-4089-8dbf-9caac6a945f7:3646:1870624588048896:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089490:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588048768 00000100:00100000:0.0:1783967284.089492:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049152 00000100:00100000:1.0:1783967284.089496:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588048768 00000100:00100000:0.0:1783967284.089497:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049152 00000100:00100000:0.0:1783967284.089526:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049664 00000100:00100000:1.0:1783967284.089531:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588049280 00000100:00100000:1.0:1783967284.089537:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049280 00000100:00100000:0.0:1783967284.089539:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588049664 00000100:00100000:1.0:1783967284.089559:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783967284.089569:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967284.089577:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588048768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967284.089582:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588049536:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1783967284.089599:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967284.089631:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588049536:12345-0@lo:400:kworker.0 Request processed in 53us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967284.089640:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783967284.089647:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1870624588048768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089655:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783967284.089659:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783967284.089667:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588049152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089675:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967284.089684:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588049280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967284.089695:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1783967284.089704:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588049152:12345-0@lo:400:kworker.0 Request processed in 35us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967284.089712:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783967284.089731:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588049280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967284.089732:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967284.089745:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783967284.089746:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1870624588049664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089801:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588049536:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089861:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588049152:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089879:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624588050176:0@lo:400:kworker.0 00000100:00100000:1.0:1783967284.089896:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588049280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967284.089911:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588049792:0@lo:400:kworker.0 00010000:00080000:1.0:1783967284.089929:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05fba10a80 x1870624588050304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967284.089939:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588049664:12345-0@lo:400:kworker.0 Request processed in 194us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967284.089944:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588050304:0@lo:400:kworker.0 00000100:00100000:0.0:1783967284.089954:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783967284.089969:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588048768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967284.089999:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588049664:0@lo:400:kworker.0 00000100:00100000:2.0:1783967284.090490:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588050432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1783967284.090537:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783967284.090606:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783967284.090612:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783967284.090616:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783967284.090619:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783967284.090793:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050432 00000100:00100000:3.0:1783967284.090799:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050432 00000100:00100000:3.0:1783967284.090847:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783967284.090856:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588050432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1783967284.090888:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1783967284.090940:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588050432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967284.090947:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783967284.091023:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588050432:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1783967284.605493:0:24986:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f9eee701-2af2-4fba-9984-4e5f1861197d 00000001:00080000:0.0:1783967284.605510:0:24986:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1783967284.791161:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967285.111391:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588050560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783967285.111477:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967285.111597:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050560 00000100:00100000:3.0:1783967285.111605:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050560 00000100:00100000:3.0:1783967285.111660:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783967285.111678:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588050560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783967285.111725:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1783967285.111808:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588050560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967285.111817:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783967285.111956:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588050560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783967285.187065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.187160:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815040 00000100:00100000:0.0:1783967285.187170:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815040 00000100:00080000:2.0:1783967285.187316:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967285.187360:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:0.0:1783967285.187371:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18206:x1870624563815040:12345-192.168.204.59@tcp:41:lfs.0 00000004:00000024:0.0:1783967285.187414:0:24473:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1783967285.187503:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18206:x1870624563815040:12345-192.168.204.59@tcp:41:lfs.0 Request processed in 133us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.187530:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:1.0:1783967285.194650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967285.197546:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815168 00000100:00100000:2.0:1783967285.198334:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815168 00000100:00100000:2.0:1783967285.198437:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:2.0:1783967285.198448:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18206:x1870624563815168:12345-192.168.204.59@tcp:41:lfs.0 00000004:00000024:2.0:1783967285.198489:0:22663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1783967285.198588:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18206:x1870624563815168:12345-192.168.204.59@tcp:41:lfs.0 Request processed in 141us (3948us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967285.198608:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:0.0:1783967285.199291:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783967285.205147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967285.205259:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815296 00000100:00100000:3.0:1783967285.205272:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815296 00000100:00080000:0.0:1783967285.205347:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967285.205355:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783967285.205367:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18206:x1870624563815296:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:3.0:1783967285.205394:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1783967285.205462:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18206:x1870624563815296:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 98us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967285.205470:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783967285.207616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967285.207796:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815424 00000100:00100000:1.0:1783967285.207804:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815424 00000100:00100000:1.0:1783967285.207929:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:1.0:1783967285.207939:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9eee701-2af2-4fba-9984-4e5f1861197d+5:18206:x1870624563815424:12345-192.168.204.59@tcp:13:lfs.0 00002000:00000024:1.0:1783967285.207980:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967285.208059:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f9eee701-2af2-4fba-9984-4e5f1861197d+5:18206:x1870624563815424:12345-192.168.204.59@tcp:13:lfs.0 Request processed in 121us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.208066:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:0.0:1783967285.211249:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783967285.417755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967285.419926:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815552 00000100:00100000:3.0:1783967285.419940:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815552 00000100:00100000:3.0:1783967285.420014:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:3.0:1783967285.420024:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+10:18239:x1870624563815552:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783967285.420040:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967285.420056:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602179e00/0x9269c8b316068da3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7244 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967285.420084:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602179e00/0x9269c8b316068da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7244 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967285.420096:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602179e00/0x9269c8b316068da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7244 expref: 11 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967285.420105:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179e00, rc 0) 00000100:00100000:3.0:1783967285.420177:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18239:x1870624563815552:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 154us (2431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967285.420198:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 136 00000100:00100000:2.0:1783967285.428170:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.428268:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815680 00000100:00100000:0.0:1783967285.428278:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815680 00000100:00100000:0.0:1783967285.428340:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:0.0:1783967285.428350:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d87ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18239:x1870624563815680:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783967285.428513:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d87ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18239:x1870624563815680:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 163us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.428520:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 137 00000100:00100000:1.0:1783967285.438617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.438715:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815808 00000100:00100000:0.0:1783967285.438726:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815808 00000100:00100000:0.0:1783967285.438827:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:0.0:1783967285.438838:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18239:x1870624563815808:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783967285.439157:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18239:x1870624563815808:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 319us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.439166:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 138 00000100:00100000:1.0:1783967285.453621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967285.453989:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563815936 00000100:00100000:3.0:1783967285.454000:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563815936 00000100:00100000:3.0:1783967285.454097:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:3.0:1783967285.454108:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18245:x1870624563815936:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967285.454306:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18245:x1870624563815936:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 198us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967285.454314:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 139 00000100:00100000:2.0:1783967285.488580:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.488753:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816064 00000100:00100000:0.0:1783967285.488763:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816064 00000100:00100000:0.0:1783967285.488987:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:0.0:1783967285.488998:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18245:x1870624563816064:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783967285.489165:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18245:x1870624563816064:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 168us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.489173:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 140 00000100:00100000:2.0:1783967285.491630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967285.491885:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816192 00000100:00100000:3.0:1783967285.491896:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816192 00000100:00100000:3.0:1783967285.491963:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:3.0:1783967285.491974:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18245:x1870624563816192:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783967285.492181:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18245:x1870624563816192:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 153us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967285.492192:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 141 00000100:00100000:3.0:1783967285.495115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967285.497936:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816320 00000100:00100000:1.0:1783967285.497954:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816320 00000100:00100000:1.0:1783967285.498040:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:1.0:1783967285.498052:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18239:x1870624563816320:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783967285.498404:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967285.498428:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316068daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7275 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.498464:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316068daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7275 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.498478:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f57d0a00/0x9269c8b316068daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7275 expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.498509:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d0a00, rc 0) 00000100:00100000:1.0:1783967285.498855:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5748850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18239:x1870624563816320:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 746us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.498930:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 142 00000100:00100000:2.0:1783967285.505463:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.505999:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816448 00000100:00100000:0.0:1783967285.506010:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816448 00000100:00100000:0.0:1783967285.506142:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:0.0:1783967285.506154:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18239:x1870624563816448:12345-192.168.204.59@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783967285.506183:0:22655:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783967285.506207:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783967285.506212:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783967285.506215:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783967285.506217:0:22655:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1783967285.506220:0:22655:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1783967285.513153:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18239:x1870624563816448:12345-192.168.204.59@tcp:256:mount.lustre.0 Request processed in 6990us (7690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.513169:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 143 00000100:00100000:1.0:1783967285.526253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.526516:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816576 00000100:00100000:0.0:1783967285.526526:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816576 00000100:00100000:0.0:1783967285.526622:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:0.0:1783967285.526633:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18239:x1870624563816576:12345-192.168.204.59@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783967285.526652:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967285.526679:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d727c expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967285.526710:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967285.526722:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967285.526731:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0800, rc 0) 00000100:00100000:0.0:1783967285.526853:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18239:x1870624563816576:12345-192.168.204.59@tcp:101:mount.lustre.0 Request processed in 221us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.526861:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 144 00000100:00100000:2.0:1783967285.528696:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.528838:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816704 00000100:00100000:0.0:1783967285.528850:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816704 00000100:00100000:0.0:1783967285.529030:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:0.0:1783967285.529042:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18239:x1870624563816704:12345-192.168.204.59@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783967285.529240:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18239:x1870624563816704:12345-192.168.204.59@tcp:501:mount.lustre.0 Request processed in 200us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.529248:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 145 00000100:00100000:2.0:1783967285.535925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.536132:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816832 00000100:00100000:0.0:1783967285.536146:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816832 00000100:00100000:0.0:1783967285.536230:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:0.0:1783967285.536244:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f574a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18239:x1870624563816832:12345-192.168.204.59@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783967285.536473:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f574a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18239:x1870624563816832:12345-192.168.204.59@tcp:503:mount.lustre.0 Request processed in 230us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.536483:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 146 00000100:00100000:1.0:1783967285.541754:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.542068:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563816960 00000100:00100000:0.0:1783967285.542081:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563816960 00000100:00100000:0.0:1783967285.542198:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:0.0:1783967285.542211:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18250:x1870624563816960:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783967285.542432:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18250:x1870624563816960:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 224us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.542441:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 147 00000100:00100000:2.0:1783967285.544604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967285.544807:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817088 00000100:00100000:1.0:1783967285.544818:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817088 00000100:00100000:1.0:1783967285.544930:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:1.0:1783967285.544942:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18250:x1870624563817088:12345-192.168.204.59@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783967285.545160:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5748450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18250:x1870624563817088:12345-192.168.204.59@tcp:502:llog_process_th.0 Request processed in 220us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.545170:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 148 00000100:00100000:2.0:1783967285.555973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967285.556109:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.556306:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817216 00000100:00100000:0.0:1783967285.556333:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817216 00000100:00100000:0.0:1783967285.556386:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817472 00000100:00100000:0.0:1783967285.556389:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817472 00000100:00100000:0.0:1783967285.556563:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1783967285.556575:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1870624563817216:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783967285.556622:0:24473:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2b0fc6d9-97a5-4c79-b3de-7051598fbec5@192.168.204.59@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:0.0:1783967285.556683:0:24473:0:(genops.c:1406:class_connect()) connect: client 2b0fc6d9-97a5-4c79-b3de-7051598fbec5, cookie 0x9269c8b316068db8 00000004:00100000:0.0:1783967285.556722:0:24473:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1783967285.556954:0:24473:0:(import.c:65:import_set_state_nolock()) ffff9a05fe783800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967285.557050:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2399:x1870624563817216:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 474us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.557061:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1783967285.557090:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:0.0:1783967285.557096:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2399:x1870624563817472:12345-192.168.204.59@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783967285.557115:0:24473:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 2b0fc6d9-97a5-4c79-b3de-7051598fbec5@192.168.204.59@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:0.0:1783967285.557143:0:24473:0:(genops.c:1406:class_connect()) connect: client 2b0fc6d9-97a5-4c79-b3de-7051598fbec5, cookie 0x9269c8b316068dbf 00000004:00100000:0.0:1783967285.557162:0:24473:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1783967285.557224:0:24473:0:(import.c:65:import_set_state_nolock()) ffff9a05fe780000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967285.557250:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2399:x1870624563817472:12345-192.168.204.59@tcp:38:mount.lustre.0 Request processed in 153us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.557258:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1783967285.571045:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967285.571087:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967285.571118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967285.571258:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817728 00000100:00100000:1.0:1783967285.571271:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817728 00000100:00100000:1.0:1783967285.571373:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817600 00000100:00100000:1.0:1783967285.571376:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817600 00000100:00100000:1.0:1783967285.571391:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817344 00000100:00100000:1.0:1783967285.571394:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817344 00000100:00100000:1.0:1783967285.571409:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1783967285.571420:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+7:18239:x1870624563817728:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783967285.571464:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967285.571550:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+7:18239:x1870624563817728:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 130us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.571558:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:1.0:1783967285.571605:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783967285.571612:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:0:x1870624563817600:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783967285.571626:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967285.571659:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:0:x1870624563817600:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 48us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.571666:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:1.0:1783967285.571679:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:1.0:1783967285.571685:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:0:x1870624563817344:12345-192.168.204.59@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783967285.571696:0:22664:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967285.571718:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:0:x1870624563817344:12345-192.168.204.59@tcp:41:mount.lustre.0 Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.571724:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00080000:2.0:1783967285.572018:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783967285.572024:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783967285.588025:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967285.588191:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817856 00000100:00100000:1.0:1783967285.588204:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817856 00000100:00100000:1.0:1783967285.588279:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1783967285.588307:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18239:x1870624563817856:12345-192.168.204.59@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783967285.588433:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18239:x1870624563817856:12345-192.168.204.59@tcp:40:mount.lustre.0 Request processed in 128us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.588442:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:2.0:1783967285.597047:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967285.597099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.597218:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563817984 00000100:00100000:0.0:1783967285.597235:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563817984 00000100:00100000:0.0:1783967285.597307:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818112 00000100:00100000:0.0:1783967285.597311:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818112 00000100:00100000:0.0:1783967285.597342:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783967285.597353:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563817984:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783967285.597436:0:24171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2b0fc6d9-97a5-4c79-b3de-7051598fbec5@192.168.204.59@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:0.0:1783967285.597484:0:24171:0:(genops.c:1406:class_connect()) connect: client 2b0fc6d9-97a5-4c79-b3de-7051598fbec5, cookie 0x9269c8b316068dc6 00002000:00100000:0.0:1783967285.597501:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b0fc6d9-97a5-4c79-b3de-7051598fbec5/ffff9a05fe785000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783967285.597516:0:24171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1783967285.597611:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783967285.597650:0:24171:0:(import.c:65:import_set_state_nolock()) ffff9a05fe783000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967285.597740:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2399:x1870624563817984:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 386us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.597749:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783967285.597814:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783967285.597819:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2399:x1870624563818112:12345-192.168.204.59@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783967285.597838:0:24171:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2b0fc6d9-97a5-4c79-b3de-7051598fbec5@192.168.204.59@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:0.0:1783967285.597856:0:24171:0:(genops.c:1406:class_connect()) connect: client 2b0fc6d9-97a5-4c79-b3de-7051598fbec5, cookie 0x9269c8b316068dcd 00002000:00100000:0.0:1783967285.597862:0:24171:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b0fc6d9-97a5-4c79-b3de-7051598fbec5/ffff9a05fe781800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783967285.597869:0:24171:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1783967285.597920:0:24171:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783967285.597934:0:24171:0:(import.c:65:import_set_state_nolock()) ffff9a05fe787000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783967285.597959:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2399:x1870624563818112:12345-192.168.204.59@tcp:8:mount.lustre.0 Request processed in 138us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.597966:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:2.0:1783967285.599680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967285.599837:0:22673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818240 00000100:00100000:0.0:1783967285.599849:0:22673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818240 00000100:00100000:0.0:1783967285.599918:0:22673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:0.0:1783967285.599931:0:22673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18239:x1870624563818240:12345-192.168.204.59@tcp:900:mount.lustre.0 00000100:00100000:0.0:1783967285.600112:0:22673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18239:x1870624563818240:12345-192.168.204.59@tcp:900:mount.lustre.0 Request processed in 182us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967285.600121:0:22673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783967285.610914:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967285.611156:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818368 00000100:00100000:3.0:1783967285.611171:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818368 00000100:00100000:3.0:1783967285.611284:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1783967285.611308:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18239:x1870624563818368:12345-192.168.204.59@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783967285.611456:0:22666:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1783967285.611584:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18239:x1870624563818368:12345-192.168.204.59@tcp:33:mount.lustre.0 Request processed in 279us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967285.611594:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:2.0:1783967285.813253:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:3.0:1783967285.816205:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967285.819146:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818496 00000100:00100000:1.0:1783967285.819171:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818496 00000100:00100000:1.0:1783967285.821747:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:1.0:1783967285.821785:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18273:x1870624563818496:12345-192.168.204.59@tcp:101:mkdir.0 00010000:00010000:1.0:1783967285.821816:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967285.821851:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72ad expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.821981:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.822001:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.822017:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967285.822085:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783967285.822090:0:22663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783967285.822120:0:22663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.822154:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 8 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.822181:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 7 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967285.822192:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:1.0:1783967285.822196:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783967285.822201:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1c00, rc 0) 00000100:00100000:1.0:1783967285.822319:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+7:18273:x1870624563818496:12345-192.168.204.59@tcp:101:mkdir.0 Request processed in 556us (9094us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967285.822328:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00010000:00010000:2.0:1783967286.838981:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967287.863008:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967288.183030:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588050688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967288.183151:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967288.183318:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050688 00000100:00100000:1.0:1783967288.183329:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050688 00000100:00100000:1.0:1783967288.183437:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783967288.183449:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588050688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1783967288.183489:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1783967288.183549:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588050688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967288.183557:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1783967288.183736:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967288.183849:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588050688:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1783967288.706713:0:23395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2b0fc6d9-97a5-4c79-b3de-7051598fbec5 00000001:00100000:0.0:1783967288.706733:0:23395:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f9eee701-2af2-4fba-9984-4e5f1861197d 00000001:00100000:2.0:1783967288.711080:0:22642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b0fc6d9-97a5-4c79-b3de-7051598fbec5 00000001:00100000:2.0:1783967288.711098:0:22642:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f9eee701-2af2-4fba-9984-4e5f1861197d 00000001:00100000:3.0:1783967288.714149:0:24165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b0fc6d9-97a5-4c79-b3de-7051598fbec5 00000001:00100000:3.0:1783967288.714169:0:24165:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f9eee701-2af2-4fba-9984-4e5f1861197d 00010000:00010000:2.0:1783967288.889840:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783967289.045117:0:25542:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1783967289.207116:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588050816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1783967289.207192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.207654:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050816 00000100:00100000:0.0:1783967289.207662:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050816 00000100:00100000:0.0:1783967289.207715:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783967289.207725:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588050816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967289.207762:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967289.207984:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588050816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 260us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.207992:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783967289.208019:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588050944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967289.208050:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.208070:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624588051456:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.208094:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.208115:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588051968:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.208150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.208167:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fe000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588052480:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.208187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.208209:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1783967289.208216:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588051072:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.208258:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.208284:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588051584:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.208305:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.208320:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624588052096:0@lo:400:kworker.0 00000100:00100000:1.0:1783967289.208486:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588051200:0@lo:400:kworker.0 00000100:00100000:1.0:1783967289.208519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967289.208535:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588051712:0@lo:400:kworker.0 00000100:00100000:1.0:1783967289.208552:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967289.208566:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624588052224:0@lo:400:kworker.0 00000100:00100000:2.0:1783967289.208714:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588050944 00000100:00100000:2.0:1783967289.208729:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588050944 00000100:00100000:2.0:1783967289.208755:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051584 00000100:00100000:2.0:1783967289.208758:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051584 00000100:00100000:2.0:1783967289.208804:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783967289.208812:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624588050944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1783967289.208839:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1783967289.208880:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1870624588050944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967289.208887:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783967289.208902:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783967289.208908:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588051584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967289.208936:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588051584:12345-0@lo:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967289.208943:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783967289.208960:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051200 00000100:00100000:2.0:1783967289.208962:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051200 00000100:00100000:2.0:1783967289.208999:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051712 00000100:00100000:2.0:1783967289.209002:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051712 00000100:00100000:2.0:1783967289.209017:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967289.209022:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588051200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967289.209053:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588051200:12345-0@lo:400:kworker.0 Request processed in 31us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967289.209059:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967289.209068:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967289.209073:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588051712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967289.209107:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588051712:12345-0@lo:400:kworker.0 Request processed in 34us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967289.209112:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783967289.209650:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783967289.209878:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967289.209903:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588050944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967289.209920:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783967289.209931:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588052608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967289.209964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.210182:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588051584:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.210248:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051456 00000100:00100000:0.0:1783967289.210253:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051456 00000100:00100000:0.0:1783967289.210279:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051968 00000100:00100000:0.0:1783967289.210281:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051968 00000100:00100000:0.0:1783967289.210289:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052480 00000100:00100000:0.0:1783967289.210291:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052480 00000100:00100000:0.0:1783967289.210315:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052096 00000100:00100000:0.0:1783967289.210317:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052096 00000100:00100000:0.0:1783967289.210328:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783967289.210334:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624588051456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.210382:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1870624588051456:12345-0@lo:400:kworker.0 Request processed in 47us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.210397:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783967289.210410:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783967289.210415:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588051968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.210507:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1870624588051968:12345-0@lo:400:kworker.0 Request processed in 91us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.210514:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783967289.210525:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783967289.210531:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624588052480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.210556:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1870624588052480:12345-0@lo:400:kworker.0 Request processed in 26us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.210561:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783967289.210569:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783967289.210574:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624588052096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.210593:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1870624588052096:12345-0@lo:400:kworker.0 Request processed in 20us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.210598:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783967289.210623:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051072 00000100:00100000:0.0:1783967289.210626:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051072 00000100:00100000:0.0:1783967289.210646:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783967289.210651:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:3645:x1870624588051072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.210679:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:3645:x1870624588051072:12345-0@lo:400:kworker.0 Request processed in 28us (2420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.210684:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783967289.210755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967289.210928:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c2748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588052736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967289.210963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783967289.211049:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967289.211053:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783967289.211142:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052224 00000100:00100000:2.0:1783967289.211146:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052224 00000100:00100000:2.0:1783967289.211313:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783967289.211321:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624588052224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967289.211368:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1870624588052224:12345-0@lo:400:kworker.0 Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967289.211374:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1783967289.214668:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1783967289.214867:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588051328:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.214946:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967289.214984:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588051840:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967289.215017:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624588052352:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215036:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967289.215078:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588050816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967289.215111:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051328 00000100:00100000:3.0:1783967289.215117:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051328 00000100:00100000:3.0:1783967289.215161:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588051840 00000100:00100000:3.0:1783967289.215163:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588051840 00000100:00100000:3.0:1783967289.215181:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967289.215188:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588051328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215251:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588051328:12345-0@lo:400:kworker.0 Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967289.215258:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967289.215273:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967289.215278:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588051840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215299:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1870624588051840:12345-0@lo:400:kworker.0 Request processed in 22us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967289.215316:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1783967289.215331:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783967289.215358:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1783967289.215370:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588051328:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215379:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1870624588051840:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215401:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588051072:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215413:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1870624588052096:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215424:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1870624588051456:0@lo:400:kworker.0 00000100:00100000:3.0:1783967289.215436:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1870624588051968:0@lo:400:kworker.0 00010000:00080000:3.0:1783967289.215459:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05fe000700 x1870624588052480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783967289.215469:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fe000700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1870624588052480:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.218611:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588051200:0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.218628:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588051712:0@lo:400:kworker.0 00010000:00080000:0.0:1783967289.218641:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05c3485880 x1870624588052224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783967289.218651:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1870624588052224:0@lo:400:kworker.0 00000100:00100000:1.0:1783967289.223636:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052608 00000100:00100000:1.0:1783967289.223648:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052608 00000100:00100000:1.0:1783967289.223714:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052736 00000100:00100000:1.0:1783967289.223725:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052736 00000100:00100000:1.0:1783967289.223748:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783967289.223758:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588052608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967289.223970:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967289.224069:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588052608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 312us (14102us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967289.224077:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783967289.224097:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783967289.224105:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588052736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783967289.224116:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967289.224168:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588052736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (13204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967289.224174:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783967289.224245:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588052608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1783967289.233348:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052352 00000100:00100000:0.0:1783967289.233365:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052352 00000100:00100000:0.0:1783967289.233449:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967289.233461:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624588052352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967289.233559:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1870624588052352:12345-0@lo:400:kworker.0 Request processed in 100us (18520us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967289.233567:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783967289.233632:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c2748700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588052736:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783967289.234037:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967289.234129:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1870624588052352:0@lo:400:kworker.0 00010000:00010000:2.0:1783967289.911822:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967290.232326:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588052864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783967290.232454:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967290.232570:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588052864 00000100:00100000:2.0:1783967290.232578:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588052864 00000100:00100000:2.0:1783967290.232649:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783967290.232660:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588052864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783967290.232696:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967290.233066:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588052864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 407us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967290.233076:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783967290.233076:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588052864:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1783967290.297528:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783967290.624136:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967290.624292:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818624 00000100:00100000:0.0:1783967290.624303:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818624 00000100:00100000:0.0:1783967290.624364:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:0.0:1783967290.624375:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f5749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:2400:x1870624563818624:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967290.624465:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f5749850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:2400:x1870624563818624:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 91us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967290.624472:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 150 00000100:00100000:2.0:1783967290.627043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967290.627514:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818752 00000100:00100000:3.0:1783967290.627528:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818752 00000100:00100000:3.0:1783967290.627600:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:3.0:1783967290.627610:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2400:x1870624563818752:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967290.627694:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2400:x1870624563818752:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 85us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967290.627706:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00080000:2.0:1783967290.627922:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783967290.630491:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967290.630758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967290.630826:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967290.630896:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563818880 00000100:00100000:1.0:1783967290.630908:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563818880 00000100:00100000:1.0:1783967290.630977:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:1.0:1783967290.630989:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2400:x1870624563818880:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967290.631065:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2400:x1870624563818880:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967290.631073:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00080000:1.0:1783967290.631097:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967290.636099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967290.636133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967290.636222:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819008 00000100:00100000:3.0:1783967290.636232:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819008 00000100:00100000:3.0:1783967290.636294:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819136 00000100:00100000:3.0:1783967290.636298:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819136 00000100:00100000:3.0:1783967290.636328:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783967290.636337:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2401:x1870624563819008:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967290.644871:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2401:x1870624563819008:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 8513us (14367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967290.644887:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783967290.644926:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:3.0:1783967290.644938:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2400:x1870624563819136:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967290.645002:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2400:x1870624563819136:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 69us (14175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967290.645009:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00080000:3.0:1783967290.645039:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783967290.645044:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783967290.645055:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819392 00000100:00100000:3.0:1783967290.645063:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819392 00000100:00100000:3.0:1783967290.645114:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1783967290.645121:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2400:x1870624563819392:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967290.645151:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2400:x1870624563819392:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 30us (9062us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967290.645158:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00080000:3.0:1783967290.645174:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1783967290.645401:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819648 00000100:00100000:0.0:1783967290.645406:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819648 00000100:00100000:0.0:1783967290.645436:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1783967290.645443:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2400:x1870624563819648:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967290.645470:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef5bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2400:x1870624563819648:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 28us (9337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967290.645475:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1783967290.645644:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967290.645664:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819264 00000100:00100000:0.0:1783967290.645668:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819264 00000100:00100000:0.0:1783967290.645703:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783967290.645709:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2401:x1870624563819264:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967290.645736:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2401:x1870624563819264:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 27us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967290.645741:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783967290.645823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967290.645838:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819520 00000100:00100000:0.0:1783967290.645842:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819520 00000100:00100000:0.0:1783967290.645873:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:0.0:1783967290.645880:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2401:x1870624563819520:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967290.645905:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2748a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2401:x1870624563819520:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 25us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967290.645911:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00080000:3.0:1783967290.646490:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783967290.646495:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783967290.646497:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783967290.935029:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967291.452728:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1783967291.772105:0:24986:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b0fc6d9-97a5-4c79-b3de-7051598fbec5 00010000:00010000:1.0:1783967291.962696:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783967292.517060:0:25689:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecf3caff0 20000000:00000080:0.0:1783967292.517080:0:25689:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a05f1682000 uarg=0000000000000000 20000000:01000000:0.0:1783967292.517121:0:25689:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783967292.517127:0:25689:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783967292.517132:0:25689:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783967292.526259:0:25690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1783967292.526481:0:25689:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783967292.541296:0:25689:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783967292.541378:0:25689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541397:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a38 expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541406:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a46 expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541433:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068a85 expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541439:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068bff expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541448:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541456:0:25689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541463:0:25689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541665:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.541682:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.541698:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588052992:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967292.542062:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 12 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.542071:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 12 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.542080:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053120:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967292.542126:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068bff expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.542135:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068bff expref: 23 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.542166:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053248:0@lo:104: 00000100:00100000:1.0:1783967292.542207:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783967292.542250:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068a85 expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.542259:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068a85 expref: 23 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.542266:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053376:0@lo:104: 00000100:00100000:1.0:1783967292.542287:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783967292.542310:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068a46 expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.542317:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068a46 expref: 23 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.542324:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053504:0@lo:104: 00000100:00100000:1.0:1783967292.542345:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783967292.542362:0:25689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9269c8b316068a38 expref: 23 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.542371:0:25689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9269c8b316068a38 expref: 23 pid: 22657 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.542392:0:25689:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053632:0@lo:104: 00000100:00100000:1.0:1783967292.542420:0:25689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967292.542430:0:25689:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967292.542466:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588053248 00000100:00100000:2.0:1783967292.542475:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588053248 00000100:00100000:2.0:1783967292.542516:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588053376 00000100:00100000:2.0:1783967292.542519:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588053376 00000100:00100000:2.0:1783967292.542530:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588053504 00000100:00100000:2.0:1783967292.542539:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588053504 00000100:00100000:2.0:1783967292.542551:0:22645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588053632 00000100:00100000:2.0:1783967292.542554:0:22645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588053632 00000100:00100000:2.0:1783967292.542567:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967292.542575:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+6:25689:x1870624588053248:12345-0@lo:104: 00010000:00010000:2.0:1783967292.542600:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.542668:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783967292.542675:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+6:25689:x1870624588053248:12345-0@lo:104: Request processed in 100us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967292.542684:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783967292.542704:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783967292.542709:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053248:0@lo:104: 00000100:00100000:2.0:1783967292.542713:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+5:25689:x1870624588053376:12345-0@lo:104: 00010000:00010000:2.0:1783967292.542721:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.542759:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783967292.542762:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+5:25689:x1870624588053376:12345-0@lo:104: Request processed in 53us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967292.542766:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967292.542796:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967292.542801:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+4:25689:x1870624588053504:12345-0@lo:104: 00010000:00010000:2.0:1783967292.542811:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.542850:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783967292.542852:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053376:0@lo:104: 00000100:00100000:2.0:1783967292.542859:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+4:25689:x1870624588053504:12345-0@lo:104: Request processed in 56us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967292.542866:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053504:0@lo:104: 00000100:00100000:2.0:1783967292.542877:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967292.542896:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783967292.542902:0:22645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:25689:x1870624588053632:12345-0@lo:104: 00010000:00010000:2.0:1783967292.542910:0:22645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.542946:0:22645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1783967292.542950:0:22645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:23275f43-9903-4089-8dbf-9caac6a945f7+3:25689:x1870624588053632:12345-0@lo:104: Request processed in 50us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967292.542955:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783967292.543252:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053632:0@lo:104: 00010000:00010000:3.0:1783967292.544444:0:22651:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783967292.544456:0:22651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.544466:0:22651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030400 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:3.0:1783967292.544470:0:22651:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.544479:0:22651:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783967292.544486:0:22651:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967292.544491:0:22651:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967292.545120:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783967292.545128:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545135:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967292.545211:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545221:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967292.545227:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967292.545232:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967292.545282:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545289:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967292.545310:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545333:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602051600/0x9269c8b316068a85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a8c expref: -99 pid: 24164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545349:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783967292.545352:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545359:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967292.545362:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545369:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967292.545375:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967292.545380:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967292.545398:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545404:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783967292.545410:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545417:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05f5631600/0x9269c8b316068a46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a4d expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545426:0:22650:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783967292.545435:0:22650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545442:0:22650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050000 already unused, calling callback (ffffffffc150bc20) 10000000:00010000:1.0:1783967292.545444:0:22650:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545451:0:22650:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783967292.545456:0:22650:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783967292.545461:0:22650:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783967292.545474:0:22650:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.545480:0:22650:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967292.546457:0:22651:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.546465:0:22651:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783967292.546480:0:22651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.546487:0:22651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a05c0030400/0x9269c8b316068bff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068c06 expref: -99 pid: 24985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.547240:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967292.547242:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967292.547245:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783967292.547256:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967292.547274:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588054016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967292.547335:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967292.547393:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967292.547399:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588054144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967292.547416:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967292.547444:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054016 00000100:00100000:3.0:1783967292.547451:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054016 00010000:00010000:3.0:1783967292.547477:0:24196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a38 expref: 24 pid: 22657 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.547684:0:22650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.547693:0:22650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.159@tcp lock: ffff9a0602050000/0x9269c8b316068a38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9269c8b316068a3f expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.547709:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967292.547710:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783967292.547712:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967292.547722:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588053760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967292.547747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967292.547764:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967292.547782:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588053888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967292.547807:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967292.547828:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054144 00000100:00100000:1.0:1783967292.547832:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054144 00010000:00010000:1.0:1783967292.548077:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068bff expref: 25 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967292.548278:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588053760 00000100:00100000:3.0:1783967292.548281:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588053760 00010000:00010000:3.0:1783967292.548294:0:24196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a85 expref: 26 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.548327:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588053888 00000100:00100000:1.0:1783967292.548329:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588053888 00010000:00010000:1.0:1783967292.548339:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a46 expref: 27 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967292.548354:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783967292.548363:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23275f43-9903-4089-8dbf-9caac6a945f7+27:3647:x1870624588054016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967292.548380:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967292.548393:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+27:3647:x1870624588054144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967292.548397:0:24196:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00010000:00010000:2.0:1783967292.548406:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783967292.548407:0:24196:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1783967292.548416:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068bff expref: 27 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.548430:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068bff expref: 27 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967292.548431:0:22647:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1783967292.548443:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783967292.548451:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+27:3645:x1870624588053888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967292.548454:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068c06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068bff expref: 27 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.548460:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967292.548467:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a46 expref: 26 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.548469:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783967292.548479:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068a46 expref: 26 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.548491:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a0602050600/0x9269c8b316068a4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068a46 expref: 26 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967292.548518:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+26:3647:x1870624588054144:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967292.548526:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783967292.548547:0:22648:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1783967292.548567:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1783967292.548575:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967292.548579:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+24:3645:x1870624588053760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783967292.548589:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967292.548594:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a85 expref: 24 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.548602:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068a85 expref: 24 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.548611:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1800/0x9269c8b316068a8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068a85 expref: 24 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.548620:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967292.548656:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23275f43-9903-4089-8dbf-9caac6a945f7+23:3645:x1870624588053760:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967292.548663:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783967292.548669:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23275f43-9903-4089-8dbf-9caac6a945f7+23:3645:x1870624588053888:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967292.548686:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783967292.548703:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588053888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783967292.548713:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588053760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783967292.549045:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967292.549052:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9269c8b316068a38 expref: 21 pid: 22657 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.549062:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9269c8b316068a38 expref: 21 pid: 22657 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.549072:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1600/0x9269c8b316068a3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9269c8b316068a38 expref: 21 pid: 22657 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967292.549090:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783967292.549115:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23275f43-9903-4089-8dbf-9caac6a945f7+20:3647:x1870624588054016:12345-0@lo:103:ldlm_bl.0 Request processed in 753us (1780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967292.549121:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783967292.549289:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588054144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783967292.549297:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:23275f43-9903-4089-8dbf-9caac6a945f7:3647:1870624588054016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783967292.549442:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588052992:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967292.549457:0:25689:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25689:1870624588053120:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783967292.549472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967292.549516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00010000:00010000:1.0:1783967292.549681:0:25689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967292.549756:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819776 00000100:00100000:2.0:1783967292.549763:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819776 00000100:00100000:3.0:1783967292.549813:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563819904 00000100:00100000:3.0:1783967292.549817:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563819904 00010000:00010000:3.0:1783967292.549840:0:24196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 14 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967292.549875:0:24196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 13 00000100:00100000:3.0:1783967292.549883:0:24196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07861a25-7be1-4505-8a1a-db0e790c2e46+14:2401:x1870624563819904:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967292.549893:0:24196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967292.549897:0:24196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 14 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.549906:0:24196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 14 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.550262:0:24196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d1400/0x9269c8b316068d72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d720c expref: 14 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.550277:0:24196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967292.550330:0:24196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c2749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:07861a25-7be1-4505-8a1a-db0e790c2e46+13:2401:x1870624563819904:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 448us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967292.550338:0:24196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 13 00010000:00010000:2.0:1783967292.550378:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967292.550411:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 14 00000100:00100000:2.0:1783967292.550419:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef378450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07861a25-7be1-4505-8a1a-db0e790c2e46+12:2401:x1870624563819776:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783967292.550429:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967292.550433:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550452:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550463:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068db1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d727c expref: 12 pid: 22656 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550475:0:22648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550485:0:22648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550498:0:22648:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550504:0:22648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550510:0:22648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550517:0:22648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550522:0:22648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967292.550526:0:22648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550534:0:22648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550567:0:22648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967292.550578:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967292.550601:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef378450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:07861a25-7be1-4505-8a1a-db0e790c2e46+11:2401:x1870624563819776:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 182us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967292.550607:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 14 00010000:00010000:3.0:1783967292.550656:0:25689:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.550681:0:25689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.550688:0:25689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a05f57d0e00/0x9269c8b316068de2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967292.983069:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967293.307380:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588054272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1783967293.307455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967293.307653:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054272 00000100:00100000:3.0:1783967293.307661:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054272 00000100:00100000:3.0:1783967293.307839:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783967293.307852:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588054272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1783967293.307884:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1783967293.307947:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe002d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588054272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.307956:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783967293.307997:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588054272:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1783967293.310950:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1783967293.689479:0:22659:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783967293.689487:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c3485800 from 13 10000000:01000000:0.0:1783967293.689492:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967293.689543:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.689556:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.689568:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967293.689595:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.689667:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967293.689713:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d9de2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.689798:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054400 00000100:00100000:3.0:1783967293.689806:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054400 00000100:00100000:3.0:1783967293.689860:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783967293.689869:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+20:22659:x1870624588054400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783967293.689882:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967293.689895:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a0602179c00/0x9269c8b316068df0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068de9 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967293.689924:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a0602179c00/0x9269c8b316068df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068de9 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967293.689935:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a0602179c00/0x9269c8b316068df0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068de9 expref: 21 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967293.689965:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602179c00, rc 0) 00000100:00100000:3.0:1783967293.690024:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588054400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.690032:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783967293.690485:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967293.690502:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068df0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967293.690512:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068df0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967293.690586:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.690618:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967293.690651:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.690747:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054528 00000100:00100000:3.0:1783967293.690753:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054528 00000100:00100000:3.0:1783967293.690821:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783967293.690829:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588054528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.691100:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588054528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.691108:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783967293.691814:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.691859:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.691936:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967293.691969:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783967293.692039:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054656 00000100:00100000:0.0:1783967293.692044:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054656 00000100:00100000:0.0:1783967293.692092:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783967293.692099:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588054656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.692218:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588054656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967293.692234:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783967293.692340:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783967293.693537:0:25703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783967293.693845:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783967293.693877:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783967293.693890:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068df0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.693901:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0200/0x9269c8b316068de9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068df0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967293.693925:0:22659:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783967293.693929:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05f570c000 from 13 10000000:01000000:0.0:1783967293.693932:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967293.693969:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.693978:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.693987:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967293.694009:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.694065:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967293.694103:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc780 going to sleep for 11 seconds 00000100:00100000:2.0:1783967293.695084:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054784 00000100:00100000:2.0:1783967293.695094:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054784 00000100:00100000:2.0:1783967293.695158:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783967293.695169:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+21:22659:x1870624588054784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967293.695184:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967293.695201:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631800/0x9269c8b316068dfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068df7 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967293.695228:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631800/0x9269c8b316068dfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068df7 expref: 22 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967293.695241:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631800/0x9269c8b316068dfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068df7 expref: 22 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967293.695250:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631800, rc 0) 00000100:00100000:2.0:1783967293.695467:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588054784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967293.695490:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783967293.697632:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967293.697667:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068dfe expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.697680:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068dfe expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967293.697822:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.697880:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967293.697932:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.697957:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588054912 00000100:00100000:3.0:1783967293.697964:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588054912 00000100:00100000:3.0:1783967293.698018:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783967293.698027:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588054912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.698177:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588054912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.698185:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783967293.698986:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588054912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.699038:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.699096:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967293.699150:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc780 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.699155:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055040 00000100:00100000:3.0:1783967293.699161:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055040 00000100:00100000:3.0:1783967293.699203:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783967293.699210:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588055040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.699430:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588055040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.699438:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783967293.699464:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783967293.700291:0:25704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1783967293.700504:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1783967293.700524:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783967293.700535:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068dfe expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.700546:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0600/0x9269c8b316068df7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068dfe expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783967293.700555:0:22659:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783967293.700558:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a05c371f800 from 13 10000000:01000000:0.0:1783967293.700560:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783967293.700590:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.700597:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.700606:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967293.700641:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.700683:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967293.700717:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967293.701022:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055168 00000100:00100000:2.0:1783967293.701030:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055168 00000100:00100000:2.0:1783967293.701076:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783967293.701084:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+22:22659:x1870624588055168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783967293.701099:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967293.701111:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f5631400/0x9269c8b316068e0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068e05 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967293.701238:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f5631400/0x9269c8b316068e0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068e05 expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967293.701249:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f5631400/0x9269c8b316068e0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068e05 expref: 23 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967293.701258:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631400, rc 0) 00000100:00100000:2.0:1783967293.701306:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588055168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967293.701312:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783967293.701386:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967293.701401:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068e0c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.701409:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068e0c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967293.701468:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.701494:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967293.701528:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.701587:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055296 00000100:00100000:3.0:1783967293.701592:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055296 00000100:00100000:3.0:1783967293.701625:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783967293.701633:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588055296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.701748:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588055296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.701754:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783967293.702239:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c274a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783967293.702279:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fe003480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783967293.702327:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967293.702363:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967293.703947:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055424 00000100:00100000:0.0:1783967293.703961:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055424 00000100:00100000:0.0:1783967293.704032:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783967293.704041:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588055424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.706713:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588055424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2663us (4375us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967293.706728:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783967293.707060:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fe003480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783967293.708102:0:25705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1783967293.713683:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1783967293.713725:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783967293.713737:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068e0c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967293.713749:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a05f7df0400/0x9269c8b316068e05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068e0c expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783967293.713762:0:22659:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783967293.713765:0:22659:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a04c31ac800 from 13 10000000:01000000:3.0:1783967293.713900:0:22659:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783967293.713952:0:22659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967293.713960:0:22659:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967293.713972:0:22659:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967293.714002:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.714101:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967293.714204:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ef001240 going to sleep for 11 seconds 00000100:00100000:0.0:1783967293.716875:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055552 00000100:00100000:0.0:1783967293.716892:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055552 00000100:00100000:0.0:1783967293.717007:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783967293.717020:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+23:22659:x1870624588055552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967293.717038:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967293.717073:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068e1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9269c8b316068e13 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.717105:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9269c8b316068e13 expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.717117:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1a00/0x9269c8b316068e1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9269c8b316068e13 expref: 24 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.717127:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1a00, rc 0) 00000100:00100000:0.0:1783967293.717235:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588055552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967293.717242:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783967293.717332:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05ef2dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783967293.717352:0:22659:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068e1a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967293.717362:0:22659:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9269c8b316068e1a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967293.717450:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.717497:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967293.723996:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.724318:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055680 00000100:00100000:3.0:1783967293.724328:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055680 00000100:00100000:3.0:1783967293.724388:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783967293.724399:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588055680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.724661:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588055680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (7163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.724669:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783967293.725063:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.725116:0:22659:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.725181:0:22659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967293.725216:0:22659:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c38c2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967293.725306:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055808 00000100:00100000:3.0:1783967293.725310:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055808 00000100:00100000:3.0:1783967293.725346:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1783967293.725352:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588055808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.725439:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:22659:x1870624588055808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.725446:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783967293.725624:0:22659:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:23275f43-9903-4089-8dbf-9caac6a945f7:22659:1870624588055808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783967293.727223:0:25706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1783967293.729656:0:22659:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1783967293.729699:0:22659:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.159@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783967293.729712:0:22659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068e1a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967293.729725:0:22659:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.159@tcp lock: ffff9a0602179400/0x9269c8b316068e13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9269c8b316068e1a expref: -99 pid: 22659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967293.828126:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967293.828235:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820032 00000100:00100000:0.0:1783967293.828253:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820032 00000100:00100000:0.0:1783967293.828313:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:0.0:1783967293.828324:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+11:18122:x1870624563820032:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967293.828341:0:22657:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967293.828359:0:22657:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068e21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72b4 expref: -99 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.828387:0:22657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72b4 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.828399:0:22657:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df0800/0x9269c8b316068e21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72b4 expref: 12 pid: 22657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.828408:0:22657:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df0800, rc 0) 00000100:00100000:0.0:1783967293.828477:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18122:x1870624563820032:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 155us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967293.828497:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 163 00000100:00100000:2.0:1783967293.832342:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967293.832528:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820160 00000100:00100000:0.0:1783967293.832539:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820160 00000100:00100000:0.0:1783967293.832609:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:0.0:1783967293.832624:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18122:x1870624563820160:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783967293.832848:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18122:x1870624563820160:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 228us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967293.832856:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 164 00000100:00100000:1.0:1783967293.842895:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967293.843244:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820288 00000100:00100000:3.0:1783967293.843258:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820288 00000100:00100000:3.0:1783967293.843336:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:3.0:1783967293.843349:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18122:x1870624563820288:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783967293.843547:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18122:x1870624563820288:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 200us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967293.843556:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 165 00000100:00100000:3.0:1783967293.857722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967293.858220:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820416 00000100:00100000:0.0:1783967293.858240:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820416 00000100:00100000:0.0:1783967293.858691:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:0.0:1783967293.858712:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+12:18122:x1870624563820416:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783967293.858731:0:22656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967293.858751:0:22656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068e28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72bb expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.858821:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72bb expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.858835:0:22656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a05f7df1800/0x9269c8b316068e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72bb expref: 13 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967293.858845:0:22656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f7df1800, rc 0) 00000100:00100000:0.0:1783967293.859005:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18122:x1870624563820416:12345-192.168.204.59@tcp:101:ll_cfg_requeue.0 Request processed in 299us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967293.859014:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 166 00000100:00100000:2.0:1783967293.871960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967293.872105:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820544 00000100:00100000:1.0:1783967293.872121:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820544 00000100:00100000:1.0:1783967293.872206:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:1.0:1783967293.872217:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18122:x1870624563820544:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783967293.872398:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18122:x1870624563820544:12345-192.168.204.59@tcp:501:ll_cfg_requeue.0 Request processed in 181us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967293.872407:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 167 00000100:00100000:0.0:1783967293.875574:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967293.876011:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820672 00000100:00100000:3.0:1783967293.876027:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820672 00000100:00100000:2.0:1783967293.879388:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 168 00000100:00100000:2.0:1783967293.879409:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18122:x1870624563820672:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783967293.879874:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3588850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:18122:x1870624563820672:12345-192.168.204.59@tcp:503:ll_cfg_requeue.0 Request processed in 468us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967293.879884:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 168 00010000:00010000:3.0:1783967294.007821:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967294.229202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.229689:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820800 00000100:00100000:3.0:1783967294.229704:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820800 00000100:00100000:3.0:1783967294.229842:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783967294.229855:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+6:18743:x1870624563820800:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783967294.229881:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967294.229912:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72c2 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.229995:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230012:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230027:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230043:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230050:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230057:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230169:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789c00/0x9269c8b316068e44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230196:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789c00/0x9269c8b316068e44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230203:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789c00/0x9269c8b316068e44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967294.230238:0:24473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783967294.230242:0:24473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967294.230280:0:24473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789c00/0x9269c8b316068e44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230291:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230298:0:24473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230305:0:24473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230311:0:24473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.230316:0:24473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230324:0:24473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230338:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:3.0:1783967294.230341:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.230347:0:24473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230363:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230383:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230389:0:24473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230395:0:24473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230401:0:24473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.230404:0:24473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230410:0:24473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230419:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a04c3424900) 00010000:00010000:3.0:1783967294.230421:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.230425:0:24473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230430:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230468:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72c2 expref: 8 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230511:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789c00/0x9269c8b316068e44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72c2 expref: 7 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.230519:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c3424000) 00010000:00010000:3.0:1783967294.230521:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967294.230524:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe789c00, rc 0) 00000100:00080000:1.0:1783967294.231265:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783967294.231314:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c274a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18743:x1870624563820800:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1458us (2122us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.231325:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:0.0:1783967294.248252:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.248376:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563820928 00000100:00100000:1.0:1783967294.248391:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563820928 00000100:00100000:1.0:1783967294.248472:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:1.0:1783967294.248493:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ee12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18743:x1870624563820928:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783967294.248616:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ee12bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18743:x1870624563820928:12345-192.168.204.59@tcp:900:lhsmtool_posix.0 Request processed in 125us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.248625:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:0.0:1783967294.256050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.256177:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563821184 00000100:00100000:1.0:1783967294.256190:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563821184 00000100:00100000:1.0:1783967294.256320:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:1.0:1783967294.256331:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18743:x1870624563821184:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967294.256360:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967294.256388:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068e4b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72c9 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256504:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256523:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256538:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256567:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256575:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256603:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256754:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316068e60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256763:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316068e60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.256818:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316068e60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.256831:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1783967294.257043:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257052:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257060:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257067:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.257072:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257080:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257095:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a04c3424000) 00010000:00010000:1.0:1783967294.257098:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.257110:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257118:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e52 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257144:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257151:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257157:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257163:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.257166:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257172:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257181:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a05ea7dfa00) 00010000:00010000:1.0:1783967294.257184:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.257186:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.257192:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e59 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.265058:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068e4b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72c9 expref: 10 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.265100:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1400/0x9269c8b316068e60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72c9 expref: 9 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.265112:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05ea7dff00) 00010000:00010000:0.0:1783967294.265116:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783967294.265120:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1400, rc 0) 00000100:00100000:0.0:1783967294.265244:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18743:x1870624563821184:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 8911us (9207us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1783967294.265254:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 24 00000100:00100000:0.0:1783967294.274893:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.275121:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563821312 00000100:00100000:3.0:1783967294.275145:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563821312 00000100:00100000:3.0:1783967294.275233:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:3.0:1783967294.275247:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c1f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18743:x1870624563821312:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783967294.275410:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c1f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18743:x1870624563821312:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 166us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.275420:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:1.0:1783967294.283336:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967294.284356:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563821440 00000100:00100000:2.0:1783967294.284372:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563821440 00000100:00100000:2.0:1783967294.284537:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1783967294.284554:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+5:18743:x1870624563821440:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1783967294.285807:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1783967294.290727:0:22664:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6113us 00000100:00100000:2.0:1783967294.317204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.317286:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563821568 00000100:00100000:3.0:1783967294.317299:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563821568 00000100:00100000:3.0:1783967294.317376:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1783967294.317390:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18749:x1870624563821568:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967294.317417:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967294.317443:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72d0 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317537:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317571:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317585:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317602:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317609:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317614:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317680:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317688:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317696:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317704:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.317709:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317717:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317731:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:3.0:1783967294.317739:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.317746:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317752:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068e75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317811:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317819:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317825:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317830:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.317833:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317839:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317847:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a04c3424900) 00010000:00010000:3.0:1783967294.317849:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.317851:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317857:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317895:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72d0 expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317912:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:3.0:1783967294.317915:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.317918:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72d0 expref: 10 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.317928:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe789000, rc 0) 00000100:00100000:3.0:1783967294.318008:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18749:x1870624563821568:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 621us (819us total) trans 0 rc 301/301 00000100:00100000:3.0:1783967294.318016:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 27 00000100:00100000:3.0:1783967294.326628:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967294.327603:0:22671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563821696 00000100:00100000:0.0:1783967294.327618:0:22671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563821696 00000100:00100000:0.0:1783967294.327900:0:22671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967294.327914:0:22671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18749:x1870624563821696:12345-192.168.204.59@tcp:700:lfs.0 00000100:00100000:0.0:1783967294.328025:0:22671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18749:x1870624563821696:12345-192.168.204.59@tcp:700:lfs.0 Request processed in 114us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967294.328033:0:22671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:0.0:1783967294.328326:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783967294.328384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967294.330309:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588056064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967294.330354:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588056320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1783967294.330402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967294.330443:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056064 00000100:00100000:1.0:1783967294.330451:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967294.330454:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056064 00000100:00100000:3.0:1783967294.330461:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967294.330470:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967294.330500:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056320 00000100:00100000:1.0:1783967294.330506:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056320 00000100:00100000:2.0:1783967294.330520:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783967294.330532:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588056064:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967294.330615:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783967294.330624:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588056320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1783967294.330660:0:23607:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1783967294.330713:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588056320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.330721:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783967294.330764:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588056320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967294.330894:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588056832:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.330919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1783967294.330927:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1783967294.330941:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588057344:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.330968:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967294.330986:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1870624588056064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 456us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.330995:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783967294.330996:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1783967294.331003:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c44edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588056448:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967294.331047:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588056960:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967294.331069:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624588057472:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967294.331101:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056832 00000100:00100000:0.0:1783967294.331108:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056832 00000100:00100000:3.0:1783967294.331154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967294.331154:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056960 00000100:00100000:0.0:1783967294.331157:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056960 00000100:00100000:1.0:1783967294.331179:0:22657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056448 00000100:00100000:1.0:1783967294.331185:0:22657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056448 00000100:00100000:3.0:1783967294.331186:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c372b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588056064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1783967294.331190:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967294.331198:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588056832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967294.331206:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588056576:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331230:0:22657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783967294.331234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967294.331243:0:22657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:3645:x1870624588056448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967294.331249:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588056832:12345-0@lo:400:kworker.0 Request processed in 47us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967294.331261:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783967294.331277:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056576 00000100:00100000:0.0:1783967294.331281:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056576 00000100:00100000:0.0:1783967294.331308:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783967294.331315:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588056960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967294.331365:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588055936 00000100:00100000:2.0:1783967294.331370:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588055936 00000100:00100000:2.0:1783967294.331392:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056192 00000100:00100000:2.0:1783967294.331395:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056192 00000100:00100000:2.0:1783967294.331407:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967294.331413:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588055936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783967294.331434:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588057088:0@lo:400:kworker.0 00002000:00000024:2.0:1783967294.331443:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783967294.331459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967294.331476:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624588057600:0@lo:400:kworker.0 00000100:00100000:2.0:1783967294.331476:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1870624588055936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.331482:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783967294.331494:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783967294.331499:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624588056192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1783967294.331508:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1783967294.331512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967294.331527:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1870624588056192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.331533:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783967294.331537:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1870624588056192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1783967294.331552:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783967294.331560:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588056704:0@lo:400:kworker.0 00000100:00100000:2.0:1783967294.331603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.331652:0:22657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c358b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23275f43-9903-4089-8dbf-9caac6a945f7+24:3645:x1870624588056448:12345-0@lo:400:kworker.0 Request processed in 410us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.331653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967294.331664:0:22657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1783967294.331677:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624588057216:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331711:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783967294.331712:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967294.331725:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588056576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331803:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588056576:12345-0@lo:400:kworker.0 Request processed in 83us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.331811:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1783967294.331832:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783967294.331838:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783967294.331859:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c44edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:23275f43-9903-4089-8dbf-9caac6a945f7:3645:1870624588056448:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331871:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588056832:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331905:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3728a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1870624588055936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967294.331941:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588056576:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.331960:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588057344 00000100:00100000:1.0:1783967294.331964:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588057344 00000100:00100000:1.0:1783967294.331993:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588057472 00000100:00100000:1.0:1783967294.331997:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588057472 00000100:00100000:1.0:1783967294.332010:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588057088 00000100:00100000:1.0:1783967294.332013:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588057088 00000100:00100000:1.0:1783967294.332023:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588057600 00000100:00100000:1.0:1783967294.332026:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588057600 00000100:00100000:1.0:1783967294.332038:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563821952 00000100:00100000:1.0:1783967294.332040:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563821952 00000100:00100000:1.0:1783967294.332053:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588056704 00000100:00100000:1.0:1783967294.332055:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588056704 00000100:00100000:1.0:1783967294.332065:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588057216 00000100:00100000:1.0:1783967294.332075:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588057216 00000100:00100000:1.0:1783967294.332106:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783967294.332112:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624588057344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.332167:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1870624588057344:12345-0@lo:400:kworker.0 Request processed in 54us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.332175:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783967294.332190:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783967294.332198:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624588057472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.332232:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1870624588057472:12345-0@lo:400:kworker.0 Request processed in 36us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.332239:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783967294.332252:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783967294.332258:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588057088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.332309:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1870624588057088:12345-0@lo:400:kworker.0 Request processed in 51us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.332315:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783967294.332326:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783967294.332331:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624588057600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967294.332477:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+5:18743:x1870624563821440:12345-192.168.204.59@tcp:59:lhsmtool_posix.0 Request processed in 47927us (49155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.332487:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:2.0:1783967294.332909:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783967294.332918:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588056704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.332933:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1870624588057600:12345-0@lo:400:kworker.0 Request processed in 599us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.332942:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783967294.332963:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1870624588056704:12345-0@lo:400:kworker.0 Request processed in 44us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.332965:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783967294.332975:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783967294.332979:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624588057216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967294.332996:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:2.0:1783967294.333016:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18749:x1870624563821952:12345-192.168.204.59@tcp:36:lfs.0 00000100:00100000:1.0:1783967294.333021:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1870624588057216:12345-0@lo:400:kworker.0 Request processed in 44us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.333039:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1783967294.333062:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783967294.333067:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1783967294.333083:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967294.333138:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068d9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d723d expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967294.333172:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1870624588057472:0@lo:400:kworker.0 00010000:00010000:2.0:1783967294.333176:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:2.0:1783967294.333184:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00080000:1.0:1783967294.333193:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c370b480 x1870624588057344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967294.333204:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1870624588057344:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.333242:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1870624588056704:0@lo:400:kworker.0 00000100:00100000:1.0:1783967294.333256:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3709f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1870624588057216:0@lo:400:kworker.0 00010000:00010000:2.0:1783967294.333284:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.333303:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 5 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.333313:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967294.333323:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1870624588057088:0@lo:400:kworker.0 00010000:00080000:1.0:1783967294.333344:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a04c3708e00 x1870624588057600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783967294.333352:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 5 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.333368:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 5 pid: 22663 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967294.333384:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fe001180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588057728:192.168.204.59@tcp:104: 00000100:00100000:2.0:1783967294.333464:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f89840 going to sleep for 11 seconds 00000100:00100000:1.0:1783967294.333680:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c3708e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1870624588057600:0@lo:400:kworker.0 00000100:00100000:0.0:1783967294.339237:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588056960:12345-0@lo:400:kworker.0 Request processed in 7904us (8156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967294.339261:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783967294.339624:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f7e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588056960:0@lo:400:kworker.0 00000100:00100000:2.0:1783967294.339759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967294.339893:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563822080 00000100:00100000:3.0:1783967294.339894:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fe001180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588057728:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783967294.339904:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563822080 00010000:00010000:3.0:1783967294.339928:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340004:0:24196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 6 pid: 22663 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967294.340059:0:24196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00100000:0.0:1783967294.340072:0:24196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:2400:x1870624563822080:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967294.340094:0:24196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967294.340103:0:24196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 6 pid: 22663 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340117:0:24196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 6 pid: 22663 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340177:0:24196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ddb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ad expref: 6 pid: 22663 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340199:0:24196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:0.0:1783967294.340205:0:24196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340218:0:24196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340227:0:24196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.340264:0:24196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967294.340327:0:24196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe002300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2400:x1870624563822080:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 257us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967294.340336:0:24196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 15 00000100:00080000:2.0:1783967294.340442:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783967294.342292:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.342311:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.342354:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.342369:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.342383:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.344722:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.344748:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.344761:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783967294.344986:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000619fb0d3 reply state 00000000ee88cc18 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345001:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345074:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:3.0:1783967294.345077:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783967294.345083:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783967294.345090:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783967294.345100:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345108:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345116:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345122:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5631600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.345141:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345149:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345161:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a04c3346600) 00010000:00010000:3.0:1783967294.345164:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.345169:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345186:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068e83 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783967294.345211:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000619fb0d3 reply state 00000000ee88cc18 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345220:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.345227:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a04c3424900) 00010000:00010000:3.0:1783967294.345229:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1783967294.345231:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1783967294.345426:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+10:18749:x1870624563821952:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 12416us (13818us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1783967294.345436:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000040:00080000:2.0:1783967294.391487:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783967294.434166:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.434316:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563822208 00000100:00100000:1.0:1783967294.434329:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563822208 00000100:00100000:1.0:1783967294.434414:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:1.0:1783967294.434425:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+10:18757:x1870624563822208:12345-192.168.204.59@tcp:101:lctl.0 00010000:00010000:1.0:1783967294.434459:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967294.434490:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72d7 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.434859:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.434878:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.434892:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.434949:0:24473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783967294.434953:0:24473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783967294.434992:0:24473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.435030:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068e98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72d7 expref: 12 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.435054:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1600/0x9269c8b316068e9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72d7 expref: 11 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.435064:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:1.0:1783967294.435067:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783967294.435072:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1600, rc 0) 00000100:00100000:1.0:1783967294.435162:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+11:18757:x1870624563822208:12345-192.168.204.59@tcp:101:lctl.0 Request processed in 737us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.435170:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:2.0:1783967294.468362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.468500:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563822336 00000100:00100000:1.0:1783967294.468518:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563822336 00000100:00100000:3.0:1783967294.468834:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1783967294.468849:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:18758:x1870624563822336:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967294.468877:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967294.468906:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068ea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72de expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.469003:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789400/0x9269c8b316068ead lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.469022:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789400/0x9269c8b316068ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.469037:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789400/0x9269c8b316068ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967294.469106:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783967294.469111:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967294.469148:0:22664:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789400/0x9269c8b316068ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.469179:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068ea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72de expref: 7 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.469203:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789400/0x9269c8b316068ead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72de expref: 6 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.469213:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:3.0:1783967294.469217:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967294.469222:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe789400, rc 0) 00000100:00100000:3.0:1783967294.469303:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18758:x1870624563822336:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 458us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.469311:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:2.0:1783967294.475902:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.476160:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563822464 00000100:00100000:3.0:1783967294.476175:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563822464 00000100:00100000:3.0:1783967294.476267:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783967294.476291:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+6:18758:x1870624563822464:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967294.476323:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967294.476351:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068eb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72e5 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.476470:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.476513:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.476528:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.476544:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.476553:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.476561:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477014:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788200/0x9269c8b316068ec9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477024:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788200/0x9269c8b316068ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477033:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788200/0x9269c8b316068ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967294.477084:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783967294.477088:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967294.477116:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788200/0x9269c8b316068ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477144:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477163:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477170:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477177:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe788800 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.477182:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477191:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477206:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:3.0:1783967294.477210:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.477215:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477220:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788800/0x9269c8b316068ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477238:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477244:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477250:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477255:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967294.477264:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477285:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477294:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a04c3424900) 00010000:00010000:3.0:1783967294.477296:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967294.477299:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477306:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789600/0x9269c8b316068ec2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477340:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068eb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72e5 expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477355:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788200/0x9269c8b316068ec9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72e5 expref: 7 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.477362:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:3.0:1783967294.477364:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967294.477367:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe788200, rc 0) 00000100:00100000:3.0:1783967294.477458:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+7:18758:x1870624563822464:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1169us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.477466:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:2.0:1783967294.481263:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.481496:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563822592 00000100:00100000:1.0:1783967294.481510:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563822592 00000100:00100000:1.0:1783967294.481619:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:1.0:1783967294.481642:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:18758:x1870624563822592:12345-192.168.204.59@tcp:900:lfs.0 00000100:00100000:1.0:1783967294.481756:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:18758:x1870624563822592:12345-192.168.204.59@tcp:900:lfs.0 Request processed in 127us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.481766:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00080000:2.0:1783967294.483421:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1783967294.490351:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.490574:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563822848 00000100:00100000:3.0:1783967294.490591:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563822848 00000100:00100000:3.0:1783967294.490706:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:3.0:1783967294.490720:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+7:18758:x1870624563822848:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967294.490828:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967294.490875:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b316068ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72ec expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967294.491261:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1783967294.491479:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b316068ed0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ec expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.491499:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:3.0:1783967294.491503:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783967294.491510:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b316068ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72ec expref: 9 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.491531:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe788000, rc 0) 00000100:00100000:3.0:1783967294.491962:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+8:18758:x1870624563822848:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1240us (1622us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1783967294.491974:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 32 00000100:00100000:2.0:1783967294.495451:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.495578:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563823104 00000100:00100000:1.0:1783967294.495591:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563823104 00000100:00100000:1.0:1783967294.495748:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:1.0:1783967294.495761:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+8:18758:x1870624563823104:12345-192.168.204.59@tcp:36:lfs.0 00010000:00010000:1.0:1783967294.496057:0:24473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783967294.496104:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788200/0x9269c8b316068ec9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72e5 expref: 8 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.496143:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:1.0:1783967294.496150:0:24473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783967294.496183:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.496201:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.496213:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783967294.497163:0:24473:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d50e3a7 reply state 00000000e7f75b3f transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.497198:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.497206:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:1.0:1783967294.497209:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1783967294.497213:0:24473:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783967294.497224:0:24473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1783967294.497493:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+9:18758:x1870624563823104:12345-192.168.204.59@tcp:36:lfs.0 Request processed in 1731us (2051us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1783967294.497503:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 33 00000100:00100000:2.0:1783967294.502948:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.503148:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563823360 00000100:00100000:3.0:1783967294.503163:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563823360 00000100:00100000:3.0:1783967294.503300:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:3.0:1783967294.503314:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+9:18758:x1870624563823360:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783967294.503661:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+10:18758:x1870624563823360:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 349us (1051us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1783967294.503669:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1783967294.515240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.518639:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563823616 00000100:00100000:1.0:1783967294.518663:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563823616 00000100:00100000:1.0:1783967294.518766:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:1.0:1783967294.519502:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+10:18758:x1870624563823616:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783967294.519537:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967294.519568:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72f3 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.519697:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.519716:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.519732:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.519746:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.519810:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.519819:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.519969:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783967294.520088:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520097:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520104:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520111:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.520116:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520135:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520151:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:1.0:1783967294.520154:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.520160:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520167:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520199:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520205:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520211:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520216:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.520219:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520226:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520234:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a04c3424900) 00010000:00010000:1.0:1783967294.520236:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.520239:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520245:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068ef3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520576:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068ee5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72f3 expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520590:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:1.0:1783967294.520593:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967294.520605:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72f3 expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.520616:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1000, rc 0) 00000100:00100000:1.0:1783967294.520727:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+11:18758:x1870624563823616:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 1233us (5501us total) trans 12884901894 rc 301/301 00000040:00080000:0.0:1783967294.522748:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783967294.524998:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 34 00000100:00100000:0.0:1783967294.525711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.525839:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563823744 00000100:00100000:3.0:1783967294.525852:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563823744 00000100:00100000:3.0:1783967294.525919:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:3.0:1783967294.525949:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+11:18758:x1870624563823744:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:3.0:1783967294.525982:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967294.526154:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b316068f01 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d72fa expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.526361:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.526380:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.526393:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783967294.526428:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1783967294.526432:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1783967294.526457:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.526490:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b316068f01 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 13 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.526517:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.526528:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:3.0:1783967294.526531:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783967294.526535:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe789e00, rc 0) 00000100:00100000:3.0:1783967294.526626:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:18758:x1870624563823744:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 679us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.535507:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 35 00000100:00100000:2.0:1783967294.536373:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.536524:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563823872 00000100:00100000:3.0:1783967294.536537:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563823872 00000100:00100000:3.0:1783967294.536599:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1783967294.536618:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:18758:x1870624563823872:12345-192.168.204.59@tcp:37:lfs.0 00000100:00100000:2.0:1783967294.542510:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:18758:x1870624563823872:12345-192.168.204.59@tcp:37:lfs.0 Request processed in 5873us (6120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.542536:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 3 00000100:00100000:3.0:1783967294.547286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967294.547388:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563824128 00000100:00100000:2.0:1783967294.547403:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563824128 00000100:00100000:2.0:1783967294.547480:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:2.0:1783967294.547493:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c71e3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:18758:x1870624563824128:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783967294.547882:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c71e3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+13:18758:x1870624563824128:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 390us (621us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1783967294.547892:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 4 00000100:00100000:3.0:1783967294.626224:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.627391:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563824256 00000100:00100000:1.0:1783967294.627408:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563824256 00000100:00100000:1.0:1783967294.627511:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:1.0:1783967294.627524:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+11:18764:x1870624563824256:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:1.0:1783967294.628365:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967294.628402:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7301 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628498:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628517:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628532:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628545:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628694:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628702:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628962:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068f24 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628973:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068f24 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.628980:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068f24 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.629091:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1783967294.629161:0:22663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783967294.629210:0:22663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068f24 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629225:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629233:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629242:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629248:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.629252:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629260:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629341:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:1.0:1783967294.629354:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.629360:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629367:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629383:0:22663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629389:0:22663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629395:0:22663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629400:0:22663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.629403:0:22663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629408:0:22663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629415:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a04c3424900) 00010000:00010000:1.0:1783967294.629417:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.629420:0:22663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629426:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629458:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7301 expref: 13 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629482:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1a00/0x9269c8b316068f24 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7301 expref: 12 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.629490:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:1.0:1783967294.629492:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783967294.629494:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1a00, rc 0) 00000100:00100000:1.0:1783967294.629761:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+12:18764:x1870624563824256:12345-192.168.204.59@tcp:101:bash.0 Request processed in 2238us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.629820:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 36 00000100:00100000:3.0:1783967294.633715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.633824:0:22674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563824384 00000100:00100000:1.0:1783967294.633837:0:22674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563824384 00000100:00100000:1.0:1783967294.633921:0:22674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:1.0:1783967294.633933:0:22674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:18764:x1870624563824384:12345-192.168.204.59@tcp:900:bash.0 00000100:00100000:1.0:1783967294.635056:0:22674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:18764:x1870624563824384:12345-192.168.204.59@tcp:900:bash.0 Request processed in 1117us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.635072:0:22674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:3.0:1783967294.639348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967294.639454:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563824640 00000100:00100000:0.0:1783967294.639467:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563824640 00000100:00100000:0.0:1783967294.639561:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:0.0:1783967294.639575:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+12:18764:x1870624563824640:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:0.0:1783967294.639607:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783967294.639638:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068f2b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7308 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.639834:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.639875:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.639886:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.639938:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 12 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967294.639955:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 12 pid: 22662 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967294.639974:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588057856:192.168.204.59@tcp:104: 00000100:00100000:0.0:1783967294.644016:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a04c35bc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967294.645237:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.645530:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c370a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588057856:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967294.645582:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967294.645763:0:22649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563824768 00000100:00100000:3.0:1783967294.645796:0:22649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563824768 00010000:00010000:3.0:1783967294.645852:0:22649:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 13 pid: 22662 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967294.645907:0:22649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 16 00000100:00100000:3.0:1783967294.645920:0:22649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+13:2401:x1870624563824768:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967294.645940:0:22649:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967294.645948:0:22649:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 13 pid: 22662 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.645963:0:22649:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 13 pid: 22662 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.645994:0:22649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789e00/0x9269c8b316068f08 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d72fa expref: 13 pid: 22662 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.646049:0:22649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:3.0:1783967294.646055:0:22649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.646069:0:22649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.646079:0:22649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967294.646406:0:22649:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967294.646492:0:22649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3708e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:2401:x1870624563824768:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 572us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967294.646502:0:22649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 16 00010000:00010000:1.0:1783967294.647726:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.647745:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.647838:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.647854:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.647868:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.650525:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.650629:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.650691:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.650708:0:22664:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783967294.650747:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.650755:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.650763:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651261:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.651341:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651376:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651396:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:1.0:1783967294.651399:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967294.651406:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651413:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1200/0x9269c8b316068f32 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783967294.651432:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb93a0f6 reply state 00000000ff1e3d98 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651446:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651454:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a05ea7df500) 00010000:00010000:1.0:1783967294.651457:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967294.651460:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783967294.651517:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068f2b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651536:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 14 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.651544:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967294.651614:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1783967294.651617:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1e00, rc 0) 00000100:00100000:1.0:1783967294.652080:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+15:18764:x1870624563824640:12345-192.168.204.59@tcp:101:bash.0 Request processed in 12505us (12824us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1783967294.652102:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 37 00000100:00100000:0.0:1783967294.671080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967294.671397:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563824896 00000100:00100000:2.0:1783967294.671412:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563824896 00000100:00100000:2.0:1783967294.671726:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:2.0:1783967294.671741:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+15:18764:x1870624563824896:12345-192.168.204.59@tcp:101:bash.0 00010000:00010000:2.0:1783967294.671910:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967294.671944:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068f4e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d730f expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672057:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672076:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672133:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967294.672205:0:24473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783967294.672210:0:24473:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967294.672239:0:24473:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672255:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672296:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068f4e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 17 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672320:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 16 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.672330:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967294.672333:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783967294.672337:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783967294.672426:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3709f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+16:18764:x1870624563824896:12345-192.168.204.59@tcp:101:bash.0 Request processed in 688us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.672434:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 38 00000100:00100000:3.0:1783967294.677075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967294.677433:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563825152 00000100:00100000:2.0:1783967294.677450:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563825152 00000100:00100000:2.0:1783967294.677525:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:2.0:1783967294.677538:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+16:18764:x1870624563825152:12345-192.168.204.59@tcp:35:bash.0 00000100:00100000:2.0:1783967294.678535:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+17:18764:x1870624563825152:12345-192.168.204.59@tcp:35:bash.0 Request processed in 992us (1469us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1783967294.678574:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 5 00000100:00100000:3.0:1783967294.794568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.794984:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563825408 00000100:00100000:1.0:1783967294.794998:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563825408 00000100:00100000:1.0:1783967294.795083:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:1.0:1783967294.795095:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+17:18774:x1870624563825408:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783967294.795138:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967294.795167:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7316 expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.795320:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1783967294.795463:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7316 expref: 19 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.795481:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a05ea7dfa00) 00010000:00010000:1.0:1783967294.795484:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967294.795491:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7316 expref: 19 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.795510:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1c00, rc 0) 00000100:00100000:1.0:1783967294.795599:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+18:18774:x1870624563825408:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 506us (1047us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1783967294.795609:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 39 00000100:00100000:0.0:1783967294.801893:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967294.801993:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563825664 00000100:00100000:3.0:1783967294.802005:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563825664 00000100:00100000:3.0:1783967294.802140:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1783967294.802152:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+18:18774:x1870624563825664:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:3.0:1783967294.802479:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+19:18774:x1870624563825664:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 328us (601us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1783967294.802489:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 6 00000100:00100000:3.0:1783967294.870449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.870927:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563825920 00000100:00100000:1.0:1783967294.870941:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563825920 00000100:00100000:1.0:1783967294.871026:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:1.0:1783967294.871039:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+19:18777:x1870624563825920:12345-192.168.204.59@tcp:101:lfs.0 00010000:00010000:1.0:1783967294.871092:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967294.871133:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f6a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d731d expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.871287:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068f71 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.871306:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068f71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.871323:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068f71 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967294.871338:0:22663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783967294.871499:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f6a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d731d expref: 22 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.871523:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068f71 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d731d expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.871534:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967294.871537:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783967294.871540:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1800, rc 0) 00000100:00100000:1.0:1783967294.873425:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3728e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18777:x1870624563825920:12345-192.168.204.59@tcp:101:lfs.0 Request processed in 2373us (2980us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1783967294.873439:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 40 00000100:00100000:0.0:1783967294.884871:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967294.884933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967294.885057:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563826048 00000100:00100000:1.0:1783967294.885069:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563826048 00000100:00100000:1.0:1783967294.885159:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:1.0:1783967294.885190:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18777:x1870624563826048:12345-192.168.204.59@tcp:54:lfs.0 00010000:00010000:1.0:1783967294.885290:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885313:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885328:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885379:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885386:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885393:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885401:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1c00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967294.885406:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885415:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885430:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967294.885433:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783967294.885439:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967294.885445:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f7f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967294.885572:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18777:x1870624563826048:12345-192.168.204.59@tcp:54:lfs.0 Request processed in 384us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967294.885582:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 41 00000100:00100000:2.0:1783967294.886870:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563826176 00000100:00100000:2.0:1783967294.886885:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563826176 00000100:00100000:2.0:1783967294.886968:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:2.0:1783967294.886981:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9eee701-2af2-4fba-9984-4e5f1861197d+21:2400:x1870624563826176:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783967294.886997:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967294.887024:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068f71 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d731d expref: 21 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967294.887046:0:25691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967294.887052:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967294.887129:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c370a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9eee701-2af2-4fba-9984-4e5f1861197d+20:2400:x1870624563826176:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 151us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967294.887136:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:3.0:1783967294.888932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967294.889166:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563826432 00000100:00100000:2.0:1783967294.889179:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563826432 00000100:00100000:2.0:1783967294.889252:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 7 00000100:00100000:2.0:1783967294.889264:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+20:18777:x1870624563826432:12345-192.168.204.59@tcp:35:lfs.0 00000100:00100000:2.0:1783967294.889617:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c372b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18777:x1870624563826432:12345-192.168.204.59@tcp:35:lfs.0 Request processed in 354us (697us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1783967294.889626:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 7 00010000:00010000:1.0:1783967295.031860:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967295.352558:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783967295.352593:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588057984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783967295.352713:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967295.353150:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588057984 00000100:00100000:2.0:1783967295.353162:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588057984 00000100:00100000:2.0:1783967295.353231:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783967295.353243:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588057984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783967295.353317:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1783967295.353390:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588057984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.353400:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783967295.353817:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588057984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783967295.483995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.486389:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563826688 00000100:00100000:2.0:1783967295.486414:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563826688 00000100:00100000:2.0:1783967295.486524:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:2.0:1783967295.486549:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18809:x1870624563826688:12345-192.168.204.59@tcp:101:cat.0 00010000:00010000:2.0:1783967295.486585:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967295.486615:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068f86 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7324 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.486856:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068f8d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.486877:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068f8d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.486895:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068f8d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967295.486914:0:24473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783967295.487091:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068f86 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7324 expref: 24 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.487130:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068f8d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7324 expref: 23 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.487142:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.487165:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783967295.487170:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783967295.487279:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+23:18809:x1870624563826688:12345-192.168.204.59@tcp:101:cat.0 Request processed in 733us (3298us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1783967295.487289:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 42 00000100:00100000:0.0:1783967295.492619:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967295.492698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.492857:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563826944 00000100:00100000:2.0:1783967295.492870:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563826944 00000100:00100000:2.0:1783967295.492936:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:2.0:1783967295.492946:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+23:18809:x1870624563826944:12345-192.168.204.59@tcp:35:cat.0 00000100:00100000:2.0:1783967295.493342:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+24:18809:x1870624563826944:12345-192.168.204.59@tcp:35:cat.0 Request processed in 396us (741us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1783967295.493351:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 8 00000100:00100000:3.0:1783967295.493722:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563827072 00000100:00100000:3.0:1783967295.493732:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563827072 00000100:00100000:3.0:1783967295.493862:0:24196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1783967295.493874:0:24196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+24:2401:x1870624563827072:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967295.493902:0:24196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967295.493939:0:24196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068f8d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7324 expref: 24 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967295.493963:0:24196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:3.0:1783967295.493968:0:24196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967295.494028:0:24196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+23:2401:x1870624563827072:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 156us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967295.494037:0:24196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:0.0:1783967295.584570:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967295.585204:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563827328 00000100:00100000:1.0:1783967295.585218:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563827328 00000100:00100000:1.0:1783967295.585430:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:1.0:1783967295.585445:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+23:18815:x1870624563827328:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1783967295.585480:0:22662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967295.585511:0:22662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f9b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d732b expref: -99 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585678:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585696:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585706:0:22662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 24 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585714:0:22662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585827:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 24 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585845:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 24 pid: 24473 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967295.585861:0:22662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22662:1870624588058112:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967295.585987:0:22662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967295.585996:0:22662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967295.586005:0:22662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22662:1870624588058240:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967295.586027:0:22662:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321300 going to sleep for 11 seconds 00000100:00100000:0.0:1783967295.600328:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.600480:0:22648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563827456 00000100:00100000:2.0:1783967295.600493:0:22648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563827456 00010000:00010000:2.0:1783967295.600568:0:22648:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 25 pid: 24473 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967295.600631:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 17 00000100:00100000:2.0:1783967295.600643:0:22648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+25:2401:x1870624563827456:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783967295.600663:0:22648:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967295.600671:0:22648:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 25 pid: 24473 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.600701:0:22648:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 25 pid: 24473 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.600735:0:22648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.600761:0:22648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.600805:0:22648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.600812:0:22648:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967295.600892:0:22648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+25:2401:x1870624563827456:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 249us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.600900:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 17 00010000:00010000:1.0:1783967295.601163:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068f55 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d730f expref: 24 pid: 24473 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967295.601186:0:22662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8ac8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22662:1870624588058112:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967295.601199:0:22662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05d8acbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22662:1870624588058240:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967295.601231:0:22662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967295.604211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967295.607593:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563827584 00000100:00100000:0.0:1783967295.607619:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563827584 00010000:00010000:0.0:1783967295.607876:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967295.608002:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 18 00000100:00100000:0.0:1783967295.608016:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef37b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+24:2400:x1870624563827584:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967295.608040:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967295.608049:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.608065:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.608094:0:22647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316068f40 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7308 expref: 24 pid: 22664 timeout: 871 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.608128:0:22647:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:0.0:1783967295.608134:0:22647:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.608145:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.608154:0:22647:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.608199:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967295.608286:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef37b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+23:2400:x1870624563827584:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 272us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967295.608294:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 18 00010000:00010000:2.0:1783967295.608410:0:22662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.608420:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967295.608458:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783967295.608674:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b316068f9b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d732b expref: 24 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.608692:0:22662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1800/0x9269c8b316068fa2 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d732b expref: 23 pid: 22662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.608701:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.608704:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783967295.608707:0:22662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1800, rc 0) 00000100:00100000:2.0:1783967295.608739:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+23:18815:x1870624563827328:12345-192.168.204.59@tcp:101:dd.0 Request processed in 23299us (24187us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1783967295.608746:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 43 00000100:00100000:0.0:1783967295.616002:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.616096:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563827712 00000100:00100000:2.0:1783967295.616123:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563827712 00000100:00100000:2.0:1783967295.616189:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1783967295.616199:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+23:18815:x1870624563827712:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:2.0:1783967295.616228:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967295.616252:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fb0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7332 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.616294:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.616311:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.616325:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.616467:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fb0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 25 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.616489:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 24 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.616498:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.616502:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783967295.616505:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5630c00, rc 0) 00000100:00100000:2.0:1783967295.616575:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+24:18815:x1870624563827712:12345-192.168.204.59@tcp:101:dd.0 Request processed in 378us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.616582:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 44 00000100:00100000:2.0:1783967295.619840:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967295.620148:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563827968 00000100:00100000:0.0:1783967295.620162:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563827968 00000100:00100000:0.0:1783967295.620242:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 45 00000100:00100000:0.0:1783967295.620254:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+24:18815:x1870624563827968:12345-192.168.204.59@tcp:36:dd.0 00010000:00010000:0.0:1783967295.620579:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.620603:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.620618:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783967295.620671:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1783967295.620700:0:22664:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee3f84b9 reply state 0000000038abb06e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.620715:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.620723:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:0.0:1783967295.620726:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783967295.620731:0:22664:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783967295.620908:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+27:18815:x1870624563827968:12345-192.168.204.59@tcp:36:dd.0 Request processed in 654us (1080us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1783967295.620916:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 45 00000020:00080000:0.0:1783967295.620922:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783967295.623814:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.623977:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828096 00000100:00100000:2.0:1783967295.624000:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828096 00000100:00100000:2.0:1783967295.624072:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:2.0:1783967295.624082:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+27:18815:x1870624563828096:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:2.0:1783967295.624124:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967295.624150:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fc5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7339 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.624254:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fc5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7339 expref: 28 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.624271:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fc5 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7339 expref: 28 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.624295:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.624298:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783967295.624303:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783967295.624385:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18815:x1870624563828096:12345-192.168.204.59@tcp:101:dd.0 Request processed in 305us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.624393:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 46 00000100:00100000:3.0:1783967295.663407:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967295.667711:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828352 00000100:00100000:0.0:1783967295.667731:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828352 00000100:00100000:2.0:1783967295.668043:0:24196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:2.0:1783967295.668058:0:24196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18815:x1870624563828352:12345-192.168.204.59@tcp:103:dd.0 00010000:00010000:2.0:1783967295.668081:0:24196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967295.668129:0:24196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fc5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7339 expref: 28 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.668156:0:24196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.668179:0:24196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967295.669955:0:24196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+27:18815:x1870624563828352:12345-192.168.204.59@tcp:103:dd.0 Request processed in 1886us (6550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.669971:0:24196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 2 00000100:00100000:1.0:1783967295.685083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967295.685486:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828480 00000100:00100000:0.0:1783967295.685500:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828480 00000100:00100000:0.0:1783967295.685627:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:0.0:1783967295.685640:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+27:18815:x1870624563828480:12345-192.168.204.59@tcp:58:dd.0 00010000:00010000:0.0:1783967295.685846:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.685869:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967295.685883:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783967295.690540:0:22664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783967295.690582:0:22664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1783967295.690846:0:22664:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1783967295.690991:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+27:18815:x1870624563828480:12345-192.168.204.59@tcp:58:dd.0 Request processed in 5345us (5912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967295.691005:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 47 00000100:00100000:1.0:1783967295.692997:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.693148:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828608 00000100:00100000:2.0:1783967295.693161:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828608 00000100:00100000:2.0:1783967295.693239:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:2.0:1783967295.693250:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+27:18815:x1870624563828608:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:2.0:1783967295.693279:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967295.693307:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7340 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.693384:0:24473:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.693396:0:24473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 28 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.693420:0:24473:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.693437:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 28 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.693453:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967295.693457:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783967295.693461:0:24473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 28 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967295.693495:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f5631600, rc 0) 00000100:00100000:2.0:1783967295.693579:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05d8acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18815:x1870624563828608:12345-192.168.204.59@tcp:101:dd.0 Request processed in 331us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.693587:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 48 00000100:00100000:3.0:1783967295.744285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967295.744321:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967295.744356:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967295.744389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.744417:0:22656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828736 00000100:00100000:3.0:1783967295.744428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967295.744435:0:22656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828736 00000100:00100000:3.0:1783967295.744461:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829248 00000100:00100000:3.0:1783967295.744471:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829248 00000100:00080000:2.0:1783967295.744523:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783967295.744544:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829760 00000100:00100000:3.0:1783967295.744549:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829760 00000100:00100000:2.0:1783967295.744557:0:22656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:2.0:1783967295.744575:0:22656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:2402:x1870624563828736:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967295.744602:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00080000:2.0:1783967295.744607:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783967295.744617:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2402:x1870624563829248:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967295.744733:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:0.0:1783967295.744748:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2402:x1870624563829760:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967295.744868:0:22656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:07861a25-7be1-4505-8a1a-db0e790c2e46+13:2402:x1870624563828736:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 298us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.744877:0:22656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 170 00000100:00100000:2.0:1783967295.744926:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828992 00000100:00100000:2.0:1783967295.744932:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828992 00000100:00100000:2.0:1783967295.744961:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829504 00000100:00100000:3.0:1783967295.744963:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2402:x1870624563829248:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 349us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.744967:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829504 00000100:00100000:3.0:1783967295.744979:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:2.0:1783967295.745011:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:2.0:1783967295.745022:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2402:x1870624563828992:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967295.745127:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:1.0:1783967295.745136:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2402:x1870624563829504:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:1.0:1783967295.745165:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2402:x1870624563829504:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 32us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967295.745171:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1783967295.745576:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2402:x1870624563828992:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 554us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.745583:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:0.0:1783967295.751302:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2402:x1870624563829760:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 6536us (6856us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967295.751324:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:1.0:1783967295.754376:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967295.754546:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967295.754577:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967295.754653:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829120 00000100:00100000:3.0:1783967295.754670:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829120 00000100:00100000:3.0:1783967295.754796:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:3.0:1783967295.754810:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2402:x1870624563829120:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967295.754926:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2402:x1870624563829120:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967295.754935:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00080000:0.0:1783967295.755948:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783967295.759115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967295.760566:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829632 00000100:00100000:3.0:1783967295.760585:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829632 00000100:00100000:3.0:1783967295.760701:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00100000:3.0:1783967295.760714:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2402:x1870624563829632:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:3.0:1783967295.760860:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+5:2402:x1870624563829632:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 149us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967295.760870:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 23 00000100:00080000:3.0:1783967295.760900:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783967295.761745:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563828864 00000100:00100000:2.0:1783967295.761759:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563828864 00000100:00100000:2.0:1783967295.762226:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829376 00000100:00100000:2.0:1783967295.762244:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829376 00000100:00100000:2.0:1783967295.762616:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:2.0:1783967295.762631:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+28:2402:x1870624563828864:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:0.0:1783967295.762723:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:0.0:1783967295.762734:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:2402:x1870624563829376:12345-192.168.204.59@tcp:400:kworker.0 00000100:00100000:2.0:1783967295.762751:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+28:2402:x1870624563828864:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 125us (8386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967295.762758:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:0.0:1783967295.762764:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b0fc6d9-97a5-4c79-b3de-7051598fbec5+12:2402:x1870624563829376:12345-192.168.204.59@tcp:400:kworker.0 Request processed in 35us (8188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967295.762800:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00010000:00010000:3.0:1783967296.055862:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783967296.567519:0:22698:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1783967296.567534:0:22698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783967296.567568:0:22698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1783967296.567581:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1783967296.567943:0:22698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3485880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22698:1870624588058368:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783967296.568130:0:22698:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05d8c4a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783967296.579419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.579419:0:22698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3485880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22698:1870624588058368:192.168.204.59@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783967296.579546:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563829888 00000100:00100000:1.0:1783967296.579557:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563829888 00000100:00100000:1.0:1783967296.579661:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00100000:1.0:1783967296.579676:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18817:x1870624563829888:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783967296.579719:0:22664:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783967296.579932:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18817:x1870624563829888:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 259us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967296.579942:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 49 00000100:00080000:3.0:1783967296.580069:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967296.590519:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.593398:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563830016 00000100:00100000:2.0:1783967296.593419:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563830016 00000100:00100000:2.0:1783967296.593705:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:2.0:1783967296.593719:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18817:x1870624563830016:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783967296.594308:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594376:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594395:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594416:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594424:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594431:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594463:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594957:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.594967:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967296.595034:0:22662:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783967296.595039:0:22662:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1783967296.595980:0:22662:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596007:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596014:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596022:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596029:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f5630600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967296.596035:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596043:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596302:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05ea7dff00) 00010000:00010000:2.0:1783967296.596306:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967296.596313:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596346:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630600/0x9269c8b316068fda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596366:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596373:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596380:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596385:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967296.596389:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596395:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596404:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a04c1ccb400) 00010000:00010000:2.0:1783967296.596406:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967296.596409:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596414:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068fe1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596436:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596442:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596459:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596464:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967296.596467:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596473:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596481:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967296.596483:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967296.596486:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.596492:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fe8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967296.596635:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18817:x1870624563830016:12345-192.168.204.59@tcp:34:lhsmtool_posix.0 Request processed in 2912us (6124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.596648:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 50 00000100:00100000:0.0:1783967296.605638:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.606073:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563830272 00000100:00100000:2.0:1783967296.606117:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563830272 00000100:00100000:2.0:1783967296.606207:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:2.0:1783967296.606220:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+28:18817:x1870624563830272:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783967296.606256:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967296.606285:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7347 expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606468:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606487:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606501:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783967296.606513:0:24473:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783967296.606611:0:24473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606619:0:24473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606626:0:24473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606632:0:24473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967296.606637:0:24473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606645:0:24473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606658:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:2.0:1783967296.606661:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783967296.606665:0:24473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606682:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b316068ff6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606729:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7347 expref: 30 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606740:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a05ea7dff00) 00010000:00010000:2.0:1783967296.606742:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783967296.606745:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316068fef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7347 expref: 30 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.606754:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050000, rc 0) 00000100:00100000:2.0:1783967296.606878:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+29:18817:x1870624563830272:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 659us (1255us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1783967296.606886:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 51 00000100:00100000:3.0:1783967296.614115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.615106:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563830400 00000100:00100000:0.0:1783967296.615124:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563830400 00000100:00100000:0.0:1783967296.615883:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783967296.615904:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+29:18817:x1870624563830400:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783967296.615980:0:22663:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783967296.616172:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+29:18817:x1870624563830400:12345-192.168.204.59@tcp:53:lhsmtool_posix.0 Request processed in 276us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967296.616181:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 52 00000100:00100000:0.0:1783967296.633441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.633857:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563830656 00000100:00100000:2.0:1783967296.633870:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563830656 00000100:00100000:2.0:1783967296.633963:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:2.0:1783967296.633974:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+29:18817:x1870624563830656:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783967296.634008:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783967296.634039:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316069004 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d734e expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783967296.635275:0:24473:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:2.0:1783967296.635290:0:24473:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1783967296.635311:0:24473:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1783967296.635529:0:24473:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606900b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.635561:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606900b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.635715:0:24473:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606900b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.635911:0:24473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050000/0x9269c8b316069004 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d734e expref: 32 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.636101:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606900b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d734e expref: 31 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.636113:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a04c1ccb400) 00010000:00010000:2.0:1783967296.636117:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783967296.636121:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a0602050600, rc 0) 00000100:00100000:3.0:1783967296.640198:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+31:18817:x1870624563830656:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 6204us (6751us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1783967296.640546:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 53 00000100:00100000:1.0:1783967296.649740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.653436:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563830912 00000100:00100000:2.0:1783967296.653457:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563830912 00000100:00100000:2.0:1783967296.653621:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:2.0:1783967296.653635:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+31:18817:x1870624563830912:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783967296.653719:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967296.653795:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050600/0x9269c8b31606900b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d734e expref: 31 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.653823:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a04c1ccb400) 00010000:00010000:2.0:1783967296.653837:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783967296.653868:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.653908:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.653920:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654737:0:22662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654763:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654823:0:22662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654896:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654904:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654911:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654919:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602051600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967296.654924:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654948:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654959:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:2.0:1783967296.654972:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967296.654978:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.654985:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602051600/0x9269c8b316069019 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655002:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655008:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655014:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655019:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a0602050400 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:2.0:1783967296.655023:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655029:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655037:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xc8c2d092 (ffff9a04c1ccb700) 00010000:00010000:2.0:1783967296.655039:0:22662:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783967296.655042:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.655047:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a0602050400/0x9269c8b316069020 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc8c2d092 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22662 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967296.655196:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f7e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+30:18817:x1870624563830912:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 1561us (5468us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783967296.655213:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 54 00000100:00100000:2.0:1783967296.658089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.658548:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563831040 00000100:00100000:1.0:1783967296.658563:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563831040 00000100:00100000:1.0:1783967296.658758:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:1.0:1783967296.658809:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+30:18817:x1870624563831040:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967296.658853:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967296.658891:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316069027 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7355 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.659850:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b31606902e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.659874:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b31606902e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.659890:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b31606902e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.660210:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316069027 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7355 expref: 32 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.660233:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1c00/0x9269c8b31606902e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7355 expref: 31 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.660243:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:1.0:1783967296.660247:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783967296.660250:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05f57d1c00, rc 0) 00000100:00100000:1.0:1783967296.660412:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+31:18817:x1870624563831040:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 1642us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967296.660422:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 55 00000100:00100000:3.0:1783967296.668598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.669426:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563831296 00000100:00100000:0.0:1783967296.669444:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563831296 00000100:00100000:0.0:1783967296.669535:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:0.0:1783967296.669548:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+31:18817:x1870624563831296:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783967296.671109:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.671170:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.671192:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783967296.671445:0:22663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1783967296.671457:0:22663:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 772872685905ns, next at 773872683030ns, rc = 0 00000004:00010000:0.0:1783967296.671536:0:22663:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ad8a877 reply state 00000000cdeea59d transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.671554:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.671563:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:0.0:1783967296.671566:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1783967296.671571:0:22663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783967296.673933:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+33:18817:x1870624563831296:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 4368us (5332us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1783967296.673951:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 56 00000100:00100000:0.0:1783967296.680677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967296.680867:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563831424 00000100:00100000:3.0:1783967296.680883:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563831424 00000100:00100000:3.0:1783967296.681906:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1783967296.681928:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+33:18817:x1870624563831424:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783967296.682196:0:24473:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967296.682229:0:24473:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d735c expref: -99 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.682310:0:24473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 34 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.682328:0:24473:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 34 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.682349:0:24473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:3.0:1783967296.682352:0:24473:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783967296.682357:0:24473:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe788000, rc 0) 00000100:00100000:3.0:1783967296.682443:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+34:18817:x1870624563831424:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 523us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967296.682451:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 57 00000100:00100000:3.0:1783967296.692260:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.693568:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563831552 00000100:00100000:0.0:1783967296.693587:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563831552 00000100:00100000:0.0:1783967296.693703:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1783967296.693723:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2401:x1870624563831552:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783967296.694168:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2401:x1870624563831552:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 445us (1922us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1783967296.694178:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 25 00000100:00100000:0.0:1783967296.703202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.703513:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563831808 00000100:00100000:2.0:1783967296.703526:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563831808 00000100:00100000:2.0:1783967296.703599:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:2.0:1783967296.703612:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+34:18817:x1870624563831808:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783967296.705824:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+35:18817:x1870624563831808:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2196us (2622us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1783967296.705846:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 9 00000100:00100000:1.0:1783967296.710527:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.716312:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563832064 00000100:00100000:2.0:1783967296.716338:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563832064 00000100:00100000:2.0:1783967296.716462:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:2.0:1783967296.716475:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+35:18817:x1870624563832064:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783967296.716678:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c44edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+35:18817:x1870624563832064:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 203us (6165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.716689:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 58 00000100:00100000:3.0:1783967296.721181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.721264:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563832192 00000100:00100000:1.0:1783967296.721277:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563832192 00000100:00100000:1.0:1783967296.721365:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:1.0:1783967296.721379:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+35:18817:x1870624563832192:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967296.721406:0:22664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967296.724237:0:22664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316069043 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7363 expref: -99 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.724349:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b31606904a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.724368:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b31606904a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.724383:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b31606904a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783967296.724458:0:22664:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1783967296.724481:0:22664:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b31606904a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.724518:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1e00/0x9269c8b316069043 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7363 expref: 37 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.724538:0:22664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b31606904a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7363 expref: 36 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.724548:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:1.0:1783967296.724551:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783967296.724555:0:22664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030400, rc 0) 00000100:00100000:1.0:1783967296.725321:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+36:18817:x1870624563832192:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 3938us (4149us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967296.725335:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 59 00000100:00100000:3.0:1783967296.734037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.737210:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563832320 00000100:00100000:1.0:1783967296.737229:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563832320 00000100:00100000:1.0:1783967296.737392:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:1.0:1783967296.737407:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+6:2400:x1870624563832320:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783967296.737433:0:24171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967296.737462:0:24171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d736a expref: -99 pid: 24171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783967296.737500:0:24171:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a552e40, blocks: 0x0 00010000:00010000:1.0:1783967296.737529:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=772s v=(0 0) 00010000:00010000:1.0:1783967296.737536:0:24171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967296.737549:0:24171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 7 pid: 24171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.737576:0:24171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 7 pid: 24171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.737595:0:24171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030800, rc 0) 00000100:00100000:1.0:1783967296.737691:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2400:x1870624563832320:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 287us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967296.737699:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 26 00000100:00100000:3.0:1783967296.742100:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.742512:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563832576 00000100:00100000:2.0:1783967296.742526:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563832576 00000100:00100000:2.0:1783967296.743056:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1783967296.743072:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+36:18817:x1870624563832576:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783967296.743235:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+36:18817:x1870624563832576:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 168us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.743245:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 60 00000100:00100000:2.0:1783967296.748051:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967296.748163:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563832704 00000100:00100000:3.0:1783967296.748176:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563832704 00000100:00100000:3.0:1783967296.748251:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:3.0:1783967296.748262:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+36:18817:x1870624563832704:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783967296.750710:0:22642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1783967296.750735:0:22642:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1783967296.750946:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751219:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751228:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751236:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967296.751243:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751254:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751276:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a04c3424900) 00010000:00010000:3.0:1783967296.751280:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967296.751285:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751292:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316068e8a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751323:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751329:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751335:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751340:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789200 already unused, calling callback (ffffffffc1b1c4f0) 00000100:00100000:1.0:1783967296.751352:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588058496:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1783967296.751353:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751366:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751375:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:3.0:1783967296.751377:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967296.751380:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751386:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789200/0x9269c8b316068e91 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751401:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751407:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751412:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751418:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d1000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967296.751421:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751439:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751449:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a05ea7df500) 00010000:00010000:3.0:1783967296.751452:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1783967296.751455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783967296.751463:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751470:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d1000/0x9269c8b316068f39 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751492:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751499:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751505:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751511:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df1e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967296.751515:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751522:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751538:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00000100:00100000:1.0:1783967296.751538:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588058496 00010000:00010000:3.0:1783967296.751541:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783967296.751545:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.751549:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588058496 00010000:00010000:3.0:1783967296.751552:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df1e00/0x9269c8b316068fbe lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751567:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751584:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751590:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751595:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0a00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:3.0:1783967296.751599:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751605:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.751615:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:3.0:1783967296.751618:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783967296.751621:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.751626:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1783967296.751628:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069035 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.751642:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1870624588058496:12345-0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1783967296.751686:0:22642:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00002000:00010000:1.0:1783967296.751908:0:24170:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783967296.751917:0:24170:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783967296.751920:0:24170:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783967296.751922:0:24170:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783967296 -> 1783967296 00002000:00010000:1.0:1783967296.751925:0:24170:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1783967296.752156:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+15:18817:x1870624563832704:12345-192.168.204.59@tcp:44:lhsmtool_posix.0 Request processed in 3892us (4179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967296.752167:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 61 00000100:00100000:1.0:1783967296.752242:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1870624588058496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 603us (787us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1783967296.752251:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1783967296.752274:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783967296.752322:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a05fba13480/2, rc 0, transno 12884901892 00000100:00100000:1.0:1783967296.752331:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1870624588058496:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1783967296.753587:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.753604:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.753612:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.753618:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f57d0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:0.0:1783967296.753623:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.753631:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.753650:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a04c3424200) 00010000:00010000:0.0:1783967296.753653:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1783967296.753659:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.753666:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f57d0e00/0x9269c8b316068ede lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24473 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967296.755293:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.755388:0:24472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563832832 00000100:00100000:0.0:1783967296.755402:0:24472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563832832 00000100:00100000:0.0:1783967296.755487:0:24472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:0.0:1783967296.755501:0:24472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2400:x1870624563832832:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783967296.755677:0:24472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2400:x1870624563832832:12345-192.168.204.59@tcp:16:lhsmtool_posix.0 Request processed in 179us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967296.755687:0:24472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 28 00000100:00100000:3.0:1783967296.759658:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.759958:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833088 00000100:00100000:0.0:1783967296.759982:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833088 00000100:00100000:0.0:1783967296.760067:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:0.0:1783967296.760089:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+15:18817:x1870624563833088:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783967296.760169:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967296.760209:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030400/0x9269c8b31606904a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7363 expref: 15 pid: 22664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.760236:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:0.0:1783967296.760243:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783967296.760291:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069058 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.760308:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069058 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.760318:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069058 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783967296.760506:0:22663:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000060ce29a reply state 000000008e709afb transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069058 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.760521:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0a00/0x9269c8b316069058 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.760528:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:0.0:1783967296.760551:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1783967296.760555:0:22663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783967296.760700:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+16:18817:x1870624563833088:12345-192.168.204.59@tcp:36:lhsmtool_posix.0 Request processed in 622us (1066us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1783967296.760709:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 62 00000100:00100000:2.0:1783967296.765312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967296.765444:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833216 00000100:00100000:3.0:1783967296.765457:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833216 00000100:00100000:3.0:1783967296.765536:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 29 00000100:00100000:3.0:1783967296.765550:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+7:18817:x1870624563833216:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783967296.765583:0:24169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783967296.765611:0:24169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7371 expref: -99 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.765657:0:24169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 8 pid: 24171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.765668:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967296.765673:0:24169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967296.765680:0:24169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.765726:0:24169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 8 pid: 24171 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.765742:0:24169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 8 pid: 24171 timeout: 872 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967296.765760:0:24169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24169:1870624588058624:192.168.204.59@tcp:104: 00000100:00100000:3.0:1783967296.765932:0:24169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c3d6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783967296.773237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.773264:0:24169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:24169:1870624588058624:192.168.204.59@tcp:104: 00010000:00010000:0.0:1783967296.773326:0:24169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967296.773339:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833344 00000100:00100000:2.0:1783967296.773349:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833344 00010000:00010000:0.0:1783967296.773354:0:24169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05fe789200, rc 0) 00010000:00010000:2.0:1783967296.773397:0:25691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 9 pid: 24171 timeout: 872 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967296.773454:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1783967296.773456:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe002300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:18817:x1870624563833216:12345-192.168.204.59@tcp:101:lhsmtool_posix.0 Request processed in 7905us (8155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.773470:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9eee701-2af2-4fba-9984-4e5f1861197d+9:2400:x1870624563833344:12345-192.168.204.59@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1783967296.773472:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 29 00010000:00010000:2.0:1783967296.773494:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967296.773530:0:25691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 8 pid: 24171 timeout: 872 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.773546:0:25691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 8 pid: 24171 timeout: 872 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.773578:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2b096a/0x9269c8b316069051 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d736a expref: 8 pid: 24171 timeout: 872 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.773599:0:25691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967296.773604:0:25691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783967296.773614:0:25691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 7 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.773628:0:25691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 7 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.773672:0:25691:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 7 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967296.773709:0:25691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fe001180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25691:1870624588058752:192.168.204.59@tcp:105: 00000100:00100000:2.0:1783967296.773825:0:25691:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05f4f896c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783967296.784870:0:25691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fe001180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:25691:1870624588058752:192.168.204.59@tcp:105: 00010000:00010000:2.0:1783967296.784915:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967296.785003:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2400:x1870624563833344:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 11536us (11782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.785019:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 19 00000100:00100000:0.0:1783967296.786763:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.786923:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833472 00000100:00100000:1.0:1783967296.786936:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833472 00000100:00100000:1.0:1783967296.787010:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:1.0:1783967296.787024:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2400:x1870624563833472:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783967296.787266:0:24171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783967296.787271:0:24171:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1783967295 00002000:00010000:1.0:1783967296.787274:0:24171:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1783967294 00002000:00010000:1.0:1783967296.787276:0:24171:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783967296 -> 1783967295 00002000:00010000:1.0:1783967296.787278:0:24171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1783967296.787367:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+8:2400:x1870624563833472:12345-192.168.204.59@tcp:2:lhsmtool_posix.0 Request processed in 346us (628us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1783967296.787376:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 30 00000100:00100000:3.0:1783967296.790589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.790835:0:24170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833600 00000100:00100000:1.0:1783967296.790852:0:24170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833600 00000100:00100000:1.0:1783967296.790924:0:24170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:1.0:1783967296.790938:0:24170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+8:2403:x1870624563833600:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783967296.791031:0:24170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.791061:0:24170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.791071:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967296.791086:0:24170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783967296.791092:0:24170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.791142:0:24170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 8 pid: 24169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.791160:0:24170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 8 pid: 24169 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.791179:0:24170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24170:1870624588058880:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967296.791485:0:24170:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321300 going to sleep for 11 seconds 00000100:00100000:3.0:1783967296.797855:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.797963:0:22647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833728 00000100:00100000:0.0:1783967296.797974:0:22647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833728 00010000:00010000:0.0:1783967296.798030:0:22647:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 9 pid: 24169 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967296.798100:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 20 00000100:00100000:0.0:1783967296.798114:0:22647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:2401:x1870624563833728:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783967296.798138:0:22647:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783967296.798170:0:22647:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 9 pid: 24169 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.798189:0:22647:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 9 pid: 24169 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.798243:0:22647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783967296.798248:0:22647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783967296.798255:0:22647:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.798266:0:22647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967296.798494:0:22647:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783967296.798575:0:22647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:2401:x1870624563833728:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 462us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967296.798584:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 20 00010000:00010000:1.0:1783967296.799065:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dea1aba/0x9269c8b31606905f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7371 expref: 8 pid: 24169 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.799098:0:24170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24170:1870624588058880:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967296.799128:0:24170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799155:0:24170:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799162:0:24170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799189:0:24170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799197:0:24170:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799205:0:24170:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799214:0:24170:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:1.0:1783967296.799219:0:24170:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799230:0:24170:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799250:0:24170:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.799273:0:24170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134b87a9/0x9269c8b316069066 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.799845:0:24170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2403:x1870624563833600:12345-192.168.204.59@tcp:1:lhsmtool_posix.0 Request processed in 8905us (9267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967296.799857:0:24170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 31 00000100:00100000:3.0:1783967296.806262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.806532:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563833984 00000100:00100000:1.0:1783967296.806547:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563833984 00000100:00100000:1.0:1783967296.806636:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 63 00000100:00100000:1.0:1783967296.806648:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+16:18817:x1870624563833984:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783967296.806797:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.806823:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 16 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.806837:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.806890:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 16 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.806906:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 16 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.806925:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588059008:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967296.807057:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967296.813479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967296.813667:0:24196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563834112 00000100:00100000:3.0:1783967296.813680:0:24196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563834112 00010000:00010000:3.0:1783967296.813804:0:24196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967296.813869:0:24196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 21 00000100:00100000:3.0:1783967296.813883:0:24196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe001180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+17:2401:x1870624563834112:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783967296.813903:0:24196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783967296.813912:0:24196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.813929:0:24196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.813962:0:24196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:3.0:1783967296.813969:0:24196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 17 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.813981:0:24196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.813990:0:24196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.813999:0:24196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.814024:0:24196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783967296.814107:0:24196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe001180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+17:2401:x1870624563834112:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 227us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967296.814115:0:24196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 21 00010000:00010000:1.0:1783967296.814938:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5630c00/0x9269c8b316068fb7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7332 expref: 16 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.814977:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588059008:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967296.815006:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815018:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815025:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815345:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815362:0:22664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 16 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815371:0:22664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815413:0:22664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 16 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.815430:0:22664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 16 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.815446:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588059136:192.168.204.59@tcp:104: 00000100:00100000:1.0:1783967296.815546:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05ea321600 going to sleep for 11 seconds 00000100:00100000:1.0:1783967296.818754:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588059136:192.168.204.59@tcp:104: 00010000:00010000:1.0:1783967296.818837:0:22664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967296.820759:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:2.0:1783967296.821061:0:25691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563834240 00000100:00100000:2.0:1783967296.821073:0:25691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563834240 00010000:00010000:2.0:1783967296.821144:0:25691:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967296.821197:0:25691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 22 00000100:00100000:2.0:1783967296.821209:0:25691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9eee701-2af2-4fba-9984-4e5f1861197d+17:2401:x1870624563834240:12345-192.168.204.59@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783967296.821230:0:25691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783967296.821239:0:25691:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.821255:0:25691:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.821286:0:25691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe788000/0x9269c8b31606903c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.59@tcp remote: 0x7826aeb227d735c expref: 17 pid: 24473 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.821343:0:25691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:2.0:1783967296.821350:0:25691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.821363:0:25691:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.821373:0:25691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.821409:0:25691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783967296.821477:0:25691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f9eee701-2af2-4fba-9984-4e5f1861197d+16:2401:x1870624563834240:12345-192.168.204.59@tcp:103:ldlm_bl.0 Request processed in 270us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.821485:0:25691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 22 00010000:00010000:1.0:1783967296.821629:0:22664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.821639:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783967296.821857:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1783967296.822010:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1783967296.822055:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1783967296.822184:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22664:1870624588059264:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783967296.822263:0:22664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967296.823167:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9d84300 going to sleep for 11 seconds 00000100:00100000:2.0:1783967296.824178:0:23607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588059264 00000100:00100000:2.0:1783967296.824196:0:23607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588059264 00000100:00100000:2.0:1783967296.824380:0:23607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783967296.824394:0:23607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22664:x1870624588059264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783967296.824572:0:23607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22664:x1870624588059264:12345-0@lo:1000:mdt00_002.0 Request processed in 181us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967296.824581:0:23607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783967296.824669:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22664:1870624588059264:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783967296.824967:0:22664:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1783967296.825068:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22664:1870624588059392:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783967296.825134:0:22664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967296.826188:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9d840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783967296.826283:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588059392 00000100:00100000:0.0:1783967296.826366:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588059392 00000100:00100000:0.0:1783967296.826424:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783967296.826434:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fba12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22664:x1870624588059392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783967296.826640:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fba12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22664:x1870624588059392:12345-0@lo:1000:mdt00_002.0 Request processed in 207us (1505us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1783967296.826649:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783967296.826831:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22664:1870624588059392:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783967296.826894:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.826907:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.826939:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.826946:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030000 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967296.826952:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.826961:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.826982:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:1.0:1783967296.826985:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783967296.826991:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.826999:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030000/0x9269c8b316069074 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827043:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827049:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827055:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827061:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05f7df0e00 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967296.827064:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827093:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827103:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967296.827106:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783967296.827115:0:22664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 19 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827128:0:22664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 19 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827138:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 19 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.827207:0:22664:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f5631600/0x9269c8b316068fd3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7340 expref: 19 pid: 24473 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783967296.827224:0:22664:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588059520:192.168.204.59@tcp:105: 00000100:00100000:1.0:1783967296.828063:0:22664:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a05c9d84600 going to sleep for 11 seconds 00000100:00100000:0.0:1783967296.836670:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967296.836862:0:22664:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22664:1870624588059520:192.168.204.59@tcp:105: 00010000:00010000:1.0:1783967296.836898:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.836912:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05f7df0e00/0x9269c8b316068fcc lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.836955:0:22664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837002:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837019:0:22664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837033:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837040:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837047:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837054:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0030200 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967296.837059:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837068:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837092:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967296.837095:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783967296.837100:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837107:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030200/0x9269c8b31606907b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837121:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837135:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837141:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967296.837145:0:22665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563834368 00010000:00010000:1.0:1783967296.837146:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031600 already unused, calling callback (ffffffffc1b1c4f0) 00010000:00010000:1.0:1783967296.837149:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837154:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967296.837155:0:22665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563834368 00010000:00010000:1.0:1783967296.837163:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967296.837165:0:22664:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783967296.837168:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.837173:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031600/0x9269c8b31606906d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22664 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783967296.837213:0:22665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 10 00000100:00100000:3.0:1783967296.837224:0:22665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c71e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+20:18815:x1870624563834368:12345-192.168.204.59@tcp:49:dd.0 00000040:00080000:2.0:1783967296.837530:0:22698:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1783967296.837537:0:22698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1783967296.837601:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f9eee701-2af2-4fba-9984-4e5f1861197d+20:18817:x1870624563833984:12345-192.168.204.59@tcp:57:lhsmtool_posix.0 Request processed in 30953us (31354us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1783967296.837611:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 63 00000020:00080000:1.0:1783967296.837618:0:22664:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783967296.837621:0:22665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c71e0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+20:18815:x1870624563834368:12345-192.168.204.59@tcp:49:dd.0 Request processed in 398us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967296.837628:0:22665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 10 00000040:00080000:2.0:1783967296.837679:0:22698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1783967296.837687:0:22698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1783967296.841989:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967296.842734:0:22666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563834624 00000100:00100000:3.0:1783967296.842757:0:22666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563834624 00000100:00100000:3.0:1783967296.842984:0:22666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 11 00000100:00100000:3.0:1783967296.842997:0:22666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+19:18817:x1870624563834624:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783967296.843396:0:22666:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783967296.843443:0:22666:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1783967296.843487:0:22666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.843509:0:22666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.843523:0:22666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.843534:0:22666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.843541:0:22666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.843549:0:22666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967296.844943:0:22666:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783967296.845168:0:22666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18817:x1870624563834624:12345-192.168.204.59@tcp:35:lhsmtool_posix.0 Request processed in 2165us (3398us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1783967296.845181:0:22666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 11 00000020:00080000:3.0:1783967296.845187:0:22666:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783967296.848031:0:24194:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783967296.848050:0:24194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.848101:0:24194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967296.848107:0:24194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.848119:0:24194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.848145:0:24194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a05ea7df300) 00010000:00010000:2.0:1783967296.848148:0:24194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783967296.848153:0:24194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.848160:0:24194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05fe789000/0x9269c8b316069082 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22666 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967296.848184:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967296.848186:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783967296.848188:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783967296.850525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:0.0:1783967296.850696:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563834752 00000100:00100000:0.0:1783967296.850710:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563834752 00000100:00100000:1.0:1783967296.851268:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 64 00000100:00100000:1.0:1783967296.851286:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+21:18815:x1870624563834752:12345-192.168.204.59@tcp:101:dd.0 00010000:00010000:1.0:1783967296.851335:0:22663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783967296.851365:0:22663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b316069089 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7826aeb227d7378 expref: -99 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.851436:0:22663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316069090 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.851457:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316069090 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.851472:0:22663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316069090 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.851622:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0031000/0x9269c8b316069089 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7378 expref: 23 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.851814:0:22663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a05c0030800/0x9269c8b316069090 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.59@tcp remote: 0x7826aeb227d7378 expref: 22 pid: 22663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967296.851825:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a05ea7df900) 00010000:00010000:1.0:1783967296.851828:0:22663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783967296.851832:0:22663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a05c0030800, rc 0) 00000100:00100000:1.0:1783967296.851908:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f9eee701-2af2-4fba-9984-4e5f1861197d+22:18815:x1870624563834752:12345-192.168.204.59@tcp:101:dd.0 Request processed in 628us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967296.851917:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 64 00010000:00010000:1.0:1783967297.079366:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967297.132885:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:1.0:1783967297.133346:0:24174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563834880 00000100:00100000:1.0:1783967297.133361:0:24174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563834880 00000100:00100000:1.0:1783967297.133586:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 0 00000100:00100000:1.0:1783967297.133600:0:24174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+7:2403:x1870624563834880:12345-192.168.204.59@tcp:4:dd.0 00002000:00010000:1.0:1783967297.133680:0:24174:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a552e3f, atime: 0x6a552e3e, ctime: 0x6a552e3f, blocks: 0x0 00010000:00010000:1.0:1783967297.133712:0:24174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967297.133734:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=773s v=(0 0) 00010000:00010000:1.0:1783967297.133740:0:24174:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783967297.133750:0:24174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783967297.133834:0:24174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783967297.138570:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783967297.140200:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.59@tcp (source: 12345-192.168.204.59@tcp) 00000100:00100000:3.0:1783967297.141285:0:24176:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783967297.141301:0:24176:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1783967297.144848:0:24176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624563835008 00000100:00100000:3.0:1783967297.144869:0:24176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624563835008 00000100:00100000:3.0:1783967297.154473:0:25709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.59@tcp, seq: 1 00000100:00100000:3.0:1783967297.154502:0:25709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+8:2403:x1870624563835008:12345-192.168.204.59@tcp:4:dd.0 00010000:00010000:3.0:1783967297.154559:0:25709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967297.154582:0:25709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967297.154587:0:25709:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783967297.154595:0:25709:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783967297.157629:0:25709:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783967297.311346:0:24165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1783967297.311367:0:24165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1783967297.317393:0:24174:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1783967297.317407:0:24174:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1783967295 -> 1783967296 00002000:00010000:0.0:1783967297.317410:0:24174:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1783967295 -> 1783967296 00002000:00010000:0.0:1783967297.317413:0:24174:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1783967297.317435:0:24174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967297.317450:0:24174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967297.317470:0:24174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967297.317479:0:24174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05c0031000 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:0.0:1783967297.317484:0:24174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967297.317494:0:24174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967297.317526:0:24174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783967297.317536:0:24174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a8c2187/0x9269c8b316069097 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783967297.317711:0:24174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f9eee701-2af2-4fba-9984-4e5f1861197d+9:2403:x1870624563834880:12345-192.168.204.59@tcp:4:dd.0 Request processed in 184106us (184834us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783967297.317750:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 0 00000001:00080000:3.0:1783967297.329271:0:24165:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00010000:00010000:2.0:1783967297.329879:0:25709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967297.329894:0:25709:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967297.329903:0:25709:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967297.329910:0:25709:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a05fe789e00 already unused, calling callback (ffffffffc0f10230) 00010000:00010000:2.0:1783967297.329926:0:25709:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967297.329936:0:25709:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967297.329957:0:25709:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783967297.329966:0:25709:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb7caa6/0x9269c8b31606909e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783967297.330135:0:25709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3487480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f9eee701-2af2-4fba-9984-4e5f1861197d+5:2403:x1870624563835008:12345-192.168.204.59@tcp:4:dd.0 Request processed in 175640us (189941us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1783967297.330153:0:25709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.59@tcp, seq: 1 00010000:00010000:3.0:1783967298.104075:0:22651:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783967298.424342:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588059648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1783967298.424416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967298.424476:0:24172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588059648 00000100:00100000:0.0:1783967298.424483:0:24172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588059648 00000100:00100000:0.0:1783967298.424951:0:24172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783967298.424964:0:24172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588059648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1783967298.424989:0:24172:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923501056 avail 3684274176 00000100:00100000:0.0:1783967298.425039:0:24172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588059648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967298.425060:0:24172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783967298.425117:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588059648:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1783967298.429749:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1783967298.937598:0:25746:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1783967299.132437:0:24194:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783967299.447097:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783967299.447122:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05fba13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588059776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967299.447207:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967299.447562:0:22668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588059776 00000100:00100000:0.0:1783967299.447569:0:22668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588059776 00000100:00100000:0.0:1783967299.447619:0:22668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783967299.447628:0:22668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588059776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1783967299.447663:0:22668:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1783967299.447708:0:22668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588059776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967299.447716:0:22668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783967299.447787:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783967299.447798:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05c3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588059904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783967299.447832:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967299.448461:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05fba13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588059776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1783967299.448501:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588060032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1783967299.448533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967299.448556:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783967299.448562:0:3645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a04c1c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588060160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967299.448581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967299.448607:0:22667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060032 00000100:00100000:1.0:1783967299.448612:0:22667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060032 00000100:00100000:1.0:1783967299.448643:0:22667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783967299.448664:0:22667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588060032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1783967299.448688:0:22667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1783967299.448727:0:22667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588060032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.448741:0:22667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783967299.448763:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588059904 00000100:00100000:1.0:1783967299.448766:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588059904 00000100:00100000:1.0:1783967299.448811:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060160 00000100:00100000:1.0:1783967299.448813:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060160 00000100:00100000:1.0:1783967299.448826:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967299.448832:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05fe000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588059904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783967299.448851:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967299.448885:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05fe000700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588059904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.448891:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967299.448903:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967299.448920:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588060160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1783967299.448930:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1783967299.448955:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1870624588060160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.448961:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783967299.448988:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a04c1c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588060160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1783967299.448998:0:3645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1870624588060032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1783967299.449124:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783967299.449885:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588060416:0@lo:400:kworker.0 00000100:00100000:0.0:1783967299.449929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967299.449959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783967299.449966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588060288:0@lo:400:kworker.0 00000100:00100000:0.0:1783967299.449992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783967299.450052:0:24171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060416 00000100:00100000:0.0:1783967299.450058:0:24171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060416 00000100:00100000:0.0:1783967299.450098:0:24171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783967299.450106:0:24171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588060416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967299.450150:0:24171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05c3484a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1870624588060416:12345-0@lo:400:kworker.0 Request processed in 46us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967299.450157:0:24171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783967299.450190:0:22655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060288 00000100:00100000:0.0:1783967299.450194:0:22655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060288 00000100:00100000:0.0:1783967299.450221:0:22655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783967299.450228:0:22655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a04c3589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:3648:x1870624588060288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967299.450350:0:22655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a04c3589850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23275f43-9903-4089-8dbf-9caac6a945f7+24:3648:x1870624588060288:12345-0@lo:400:kworker.0 Request processed in 122us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967299.450357:0:22655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783967299.450416:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:23275f43-9903-4089-8dbf-9caac6a945f7:3648:1870624588060288:0@lo:400:kworker.0 00000100:00100000:0.0:1783967299.450426:0:3648:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:0.0:1783967299.450431:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a05fba13480, transno 12884901892 00000004:00080000:0.0:1783967299.450441:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:0.0:1783967299.450458:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1870624588060416:0@lo:400:kworker.0 00000100:00080000:0.0:1783967299.450611:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783967299.450615:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783967299.450645:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05c3484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588059904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783967299.451966:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588060928:0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967299.452076:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783967299.452082:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588060800:0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452102:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967299.452120:0:3648:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588061312:0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783967299.452196:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060928 00000100:00100000:1.0:1783967299.452202:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060928 00000100:00100000:1.0:1783967299.452267:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060800 00000100:00100000:1.0:1783967299.452270:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060800 00000100:00100000:1.0:1783967299.452284:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588061312 00000100:00100000:1.0:1783967299.452287:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588061312 00000100:00100000:1.0:1783967299.452303:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783967299.452310:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624588060928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452361:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1870624588060928:12345-0@lo:400:kworker.0 Request processed in 46us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.452369:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783967299.452384:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783967299.452390:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588060800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452417:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1870624588060800:12345-0@lo:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.452422:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783967299.452433:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783967299.452439:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f56aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588061312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452461:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f56aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1870624588061312:12345-0@lo:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.452466:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1783967299.452484:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1783967299.452488:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967299.452511:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1870624588060800:0@lo:400:kworker.0 00010000:00080000:1.0:1783967299.452524:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56af800 x1870624588061312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783967299.452546:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1870624588061312:0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.452557:0:3648:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1870624588060928:0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.452626:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588060672:0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.452660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967299.452762:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624588061184:0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.452803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967299.452820:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588060544:0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.452838:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967299.452852:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783967299.452858:0:3646:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588061056:0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.452880:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783967299.453042:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588061184 00000100:00100000:2.0:1783967299.453048:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588061184 00000100:00100000:2.0:1783967299.453081:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060544 00000100:00100000:2.0:1783967299.453083:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060544 00000100:00100000:2.0:1783967299.453093:0:24473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588061056 00000100:00100000:2.0:1783967299.453095:0:24473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588061056 00000100:00100000:2.0:1783967299.453108:0:24473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783967299.453123:0:24473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624588061184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783967299.453206:0:24169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588060672 00000100:00100000:1.0:1783967299.453210:0:24169:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588060672 00000100:00100000:1.0:1783967299.453524:0:24169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783967299.453532:0:24169:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588060672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.453644:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783967299.453652:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783967299.453656:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588060544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783967299.453667:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588061056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783967299.453844:0:24473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1870624588061184:12345-0@lo:400:kworker.0 Request processed in 722us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783967299.453852:0:24473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1783967299.453874:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1783967299.453877:0:22658:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783967299.453991:0:24169:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1870624588060672:12345-0@lo:400:kworker.0 Request processed in 460us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783967299.453997:0:24169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783967299.454118:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1870624588061056:12345-0@lo:400:kworker.0 Request processed in 456us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783967299.454137:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1783967299.454400:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a05f56adc00 x1870624588061056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783967315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783967299.454414:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1870624588061056:0@lo:400:kworker.0 00000100:00100000:2.0:1783967299.454428:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1870624588060672:0@lo:400:kworker.0 00000100:00100000:2.0:1783967299.454439:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1870624588061184:0@lo:400:kworker.0 00000100:00100000:3.0:1783967299.459628:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05f57aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1870624588060544:12345-0@lo:400:kworker.0 Request processed in 5963us (6775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967299.459645:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783967299.459821:0:3646:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f56ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1870624588060544:0@lo:400:kworker.0 00010000:00010000:1.0:1783967300.151347:0:22650:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783967300.478619:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783967300.478653:0:3647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588061440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783967300.478785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783967300.478850:0:24173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870624588061440 00000100:00100000:3.0:1783967300.478860:0:24173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870624588061440 00000100:00100000:3.0:1783967300.478921:0:24173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783967300.478932:0:24173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588061440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783967300.478972:0:24173:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:3.0:1783967300.479041:0:24173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a05ef2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1870624588061440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783967300.479050:0:24173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783967300.479121:0:3647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a05f57aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1870624588061440:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783967300.536071:0:23417:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 Debug log: 14469 lines, 14469 kept, 0 dropped, 0 bad.